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PREFACE 


The  SEEKVAL  IB1  experiments  documented  in  this  report  generated  what  is 
probably  the  largest  body  of  target  acquisition  data  ever  accumulated  in  a 
single  experimental  series.  These  data,  together  with  data  generated  in  the 
other  experiments  conducted  during  Phase  I,  will  provide  a  rich  field  for 
further  exploration.  The  analyses  presented  in  this  document  only  scratch 
the  surface,  being  addressed  to  the  stated  experimental  objectives  and  a 
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haustive  treatment  these  data  deserve. 
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EXECUTIVE  SUMMARY 


Objectives 


As  an  element  of  the  SEEKVAL  Program  objectives  prescribed  in 
WSEG  Report  196,  -^the  objectives  of  the  IB1  Aided  Terrain  Table  Experiments 
were  defined  as  follows: 

a  determine  the  relative  effectiveness  of  visual  search 
w  aided  by  an  acquisition  sensor  when  compared  with  direct 
visual  search  alone,  under  several  variations  of  illumina¬ 
tion,  table  configurations,  and  target  arrangements .  ay  L 

J 

bj Demonstrate  the  degree  of  utility  of  terrain  tables  with 
physical  models  as  tools  for  the  evaluation  of  alternative 
target  acquisition  systems  and  techniques. 

'  .  ) 

ExperimentalJ^actors 

There  were  nine  experimental  factors  established  in  the  IB1 
experiment:  method  of  search,  clutter,  contrast,  illumination  angle, 
number  of  targets,  pop-up  range,  pop-up  altitude,  coloration,  and  Observer 
training.  The  first  eight  of  these  were  explicitly  identified  in  the 
project  plan  and  the  Observer  training  was  implied  inasmuch  as  an  equal 
number  of  trained  and  untrained  Observers  was  used.  Table  I  provides  a 
description  of  the  IB1  experiment  design. 


Sub- 

experiment 

Number 


Number  of 
Observers 

Trained 

Untrained 

96 

96 

16 

16 

24 

24 

108 

108 

48 

48 

TABLE  I.  SUMMARY  OF  THE  IB1  EXPERIMENT  DESIGN 


Mode  Scale  Configurations  Runs 

Fixed  wing  800:1  6  1151 


Fixed  wing  800:1 


Fixed  wing  800:1 


Rotary  wing  200:1 


Rotary  wing  200:1 


Number 

Runs 

Altitude 

(Feet) 

Speed 

(Knots) 

Measure  of 
Acquisit ion 
Effectiveness 

1151 

3000 

400 

Range 

192 

3000 

400 

Range 

285 

3000 

400 

Range 

864 

Var 

0 

T  ime 

384  | 

| 

800 

0 

T  ime 

j  Method  of  Search, 
Clutter,  Contrast, 
Illumination  Angle 

Method  of  Search, 

I  Clutter,  Contrast, 
II luminat ion  of 
|  Targets 

Method  of  Search, 
Clutter,  Contrast, 
Illumination  Angle 

Method  of  Search, 
Clutter,  Contrast, 
Range,  Alt itude 

Method  of  St-arch, 
Clutter,  Range,  j 
Color  of  Targets  I 
and  background  | 
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A  brief  discussion  of  the  nine  factors  considered  in  the 
experiment  follows. 

Method  of  Search 

Fixed  wing  experiments: 

1  Direct  visual  without  any  aid  a,ailable 

2_  Direct  visual  with  a  wide  field  of  view  (WF)  television 

sensor  (8  degrees)  to  be  used  at  the  option  of  the  Observer 

3^  Direct  visual  with  a  narrow  field  of  view  (NF)  sensor 
(2  degrees) ,  also  optional 

Direct  visual  with  a  variable  field  of  view  (VF)  sensor 
(8  degrees  to  2  degrees),  also  optional. 

Rotary  wing  experiments: 

1^  Direct  visual  without  any  aid  available 

1_  Direct  visual  with  a  stabilized  optical  (monocular)  device 
to  be  used  at  the  option  of  the  Observer 

3.  Direct  visual  with  an  electro-optical  television  sensor, 
also  optional. 

Clutter 

This  was  defined  as  target-like  objects  within  a  200  meter 
radius  of  the  target  array.  The  levels  of  clutter  were: 
low — no  objects,  medium — 20  objects,  and  high — 60  objects. 

The  clutter  objects  were  scaled  the  same  as  the  targets  and 
composed  of  deciduous  trees,  bushes,  and  conifers. 

Contrast 

Contrast  was  defined  as  the  ratio  of  the  target  and  background 
luminances  in  two  different  levels;  low  —  negative  contrast 
of  -0.20  to  -0.50  and  high  —  negative  contrast  of  -0.60  to 
-0.90  (negative  contrast  meaning  that  the  target  was  darker 
than  the  background) . 

Illumination  Angle 

There  were  two  types  of  illumination:  overcast  sky  (no  shadows) 
and  direct  sunlight.  The  direct  sunlight  was  simulated  at  four 
different  azimuths  and  two  elevations: 
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Elevation  40  degrees  -  Azimuths  of  0,  45,  90  and  180  degrees 

from  the  point  of  view  of  the  Observer. 

Elevation  20  degrees  -  (the  same  four  azimuths) 

Number  of  Targets 

The  targets  were  three  U.S.  M-60  tanks,  scaled  800:1  for  the 
fixed  wing  experiments,  and  200:1  for  the  rotary  wing  tests. 

In  sub-experiment  2,  where  the  number  of  targets  was 
varied,  the  number  used  was  none,  one,  three,  and  nine. 


Pop-up  Range 


This  was  a  factor  in  the  rotary  wing  experiments  only  and  the 
ranges  assigned  were  1500,  2850,  and  4200  meters,  measured 
horizontally  from  Observer  to  target. 

Pop-up  Altitude 

This  was  a  variable  in  sub-experiment  4  only  and  the  altitudes 
assigned  were  800,  1300  and  1800  feet. 


Coloration 

Target  and  background  colorations  were  variables  only  in  sub- 
experiment  5  with  the  tanks  painted  either  olive  drab  or 
camouflaged  (pattern  painted)  and  set  against  either  a  brown 
or  green  background. 

Observer  Training 

The  Observers  used  were  evenly  divided  between  trained  and  un¬ 
trained.  The  trained  Observers  were  military  aviators  and  the 
untrained  were  civilians  with  little  or  no  flying  experience. 

Experimental  Analysis 

In  the  five  sub-experiments,  each  observer  received  all  levels 
of  only  two  factors,  usually  clutter  and  contrast,  and  only  one  level  of 
the  remaining  factors.  This  resulted  in  a  design  in  which  subjects  were 
nested  within  some  factors  and  crossed  with  others.  Analysis  of  variance 
as  well  as  certain  non-parametric  methods,  i.e.  X^,  were  used  to  analyze 
the  data.  However,  in  performing  the  sub-experiments  there  was  a  signifi¬ 
cant  number  of- missing  acquisitions  (approximately  60  percent  in  experiments 
1,  2,  and  3  and  10  percent  in  experiments  4  and  5).  This  produced  a  trun¬ 
cated  sample  in  which  the  sample  means  might  not  be  representative  of  the 
population  means.  Because  of  the  missing  data,  the  sub-experiments  were 
analyzed  by  the  GLM  as  completely  crossed  designs,  which  meant  that  the 
inter-subject  variability  could  not  be  estimated.  Consequently,  the  con¬ 
clusions  reached  from  the  analysis  of  variance  must  be  viewed  with  caution. 

The  results  of  the  x  analysis,  however,  are  not  subject  to  these  limitations. 
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Experimental  Results 

The  results  of  the  experiments  are  discussed  in  detail  in 
Sections  2.0  through  6.0.  Each  of  these  sections  is  devoted  to  a  complete 
description  and  conclusions  of  each  of  the  five  sub-experiments.  Section 
7.0  discusses  the  effects  of  the  several  variables  on  target  acquisition 
performance,  as  seen  across  the  entire  experiment.  Section  8.0  presents 
conclusions  and  recommendations.  The  appendices  contain  details  and  de¬ 
scriptions  of  facilities,  experimental  procedures,  analytical  techniques, 
and  conduct  of  the  sub-experiments. 

Table  II  shows  the  influence  of  the  nine  factors  examined  in 
the  five  sub-experiments. 


TABLE  II.  RELATIVE  INFLUENCE  OF  EXPERIMENTAL  FACTORS 


— 

Sub-experiments 

Fac  to  rs 

1 

2 

3 

U 

5 

Method  of  Search 

Significant 

Minor 

Significant 

Major 

Major 

Clutter 

Major 

Signif leant 

Significant 

Major 

Major 

Cont  rast 

Minor 

Minor 

Minor 

Significant 

No  Factor 

Illumination  Angle 

Minor 

No  Factor 

Minor 

No  Factor 

No  Factor 

Number  of  Targets 

No  Factor 

Significant 
(Range  only) 

No  Factor 

No  Factor 

No  Factor 

Pop-up  Range 

No  Factor 

No  Factor 

No  Factor 

Major 

Major 

Pop-up  Altitude 

No  Factor 

No  Factor 

No  Factor 

Minor 

No  Factor 

Colorat ion 

No  Factor 

No  Factor 

No  Factor 

No  Factor 

Minor 

Observer  Training 

Minor 

Minor 

Minor 

Significant 

Significant 

Major  -  Statistically  significant  and  exerted  powerful  influence  on  the 
results . 

Significant  -  Statistically  significant  but  not  overpowering. 

Minor  -  Not  statistically  significant,  but  showed  a  consistant  trend. 

No  Factor  -  Not  a  factor  in  the  experiment. 

Brief  discussions  of  the  results  presented  in  Table  II 

follow: 

Method  of  Search 

For  the  three  fixed  wing  sub-experiments,  the  direct  visual 
was  used  more  frequently  by  the  Observers.  However,  the  WF 
produced  the  longest  mean  range  at  acquisition  and  the  highest 
probability  of  acquisition.  For  rotary  wing,  direct  view  was 
utilized  almost  to  the  exclusion  of  the  aids  at  the  short 
ranges,  but  not  at  the  4200  meters  range. 


Clutter 


In  all  five  sub-experiments,  target  acquisition  tended  to 
degrade  progressively  as  the  clutter  density  increased  from 
medium  to  high. 


Contrast 

The  contrast  ratio  of  the  target  with  respect  to  its  back¬ 
ground  appeared  to  have  little  influence  on  target  acquisition. 

Illumination  Angle 

Sun  angle  appeared  to  have  only  minor  influence,  with  40  degree 
elevation  being  slightly  better  than  20  degrees. 

Number  of  Targets 

Increasing  the  number  of  targets  in  the  search  area  increased 
the  probability  and  range  of  detection. 

Pop-Up  Range 

In  the  rotary  wing  sub-experiments  target  acquisition  decreased 
as  range  increased. 

Pop-Up  Altitude 

In  the  rotary  wing  sub-experiments  target  acquisition  per¬ 
formance  did  not  vary  with  altitude. 

Target  and  Background  Coloration 

Target  acquisition  performance  was  not  influenced  by  target 
color  and  was  only  slightly  influenced  by  background  color. 

Observer  Training 

Trained  Observers  performed  slightly  but  consistently  better 
than  untrained  Observers  in  the  fixed  wing  sub-experiments. 
Rotary  wing  results  showed  trained  Observers  to  be  markedly 
better  than  untrained.  Intersubject  variability  within  each 
group  is  not  known. 

Conclusions 

The  overall  objective  of  the  SEEKVAL  Program,  as  stated  in 
WSEG  Report  196  is  to  evaluate  alternative  systems  and  techniques  for  ac¬ 
quiring  targets  in  combat  air  support.  It  is  concluded  that  this  objective 
was  served  in  the  IB1  Experiment  in  that  four  modes  of  target  acquisition 
were  evaluated  in  the  fixed  wing  sub -experiments  and  three  modes  were  eval¬ 
uated  in  the  rotary  wing  sub-experiments. 

The  specific  objectives  of  experiment  IB1  were: 

J_  Determination  of  Relative  Effectiveness  of  Search  Methods 

This  objective  was  accomplished.  In  general  it  was  found 
that  the  visual  aids  were  useful  in  some  cases,  particularly 


at  the  longer  ranges  (more  than  4500  meters).  However, 
at  the  shorter  ranges,  the  observer  generally  preferred 
to  use  direct,  unaided  vision.  It  appears  obvious  that 
the  aids  must  be  flexible  enough  so  that  direct  vision 
can  be  readily  substituted  when  appropriate.  Above  all, 
aids  must  not  introduce  a  task  complexity  that  negates 
operational  effectiveness.  The  helmet  sight  controlled 
variable  field  of  view  sensor  used  in  the  fixed  wing 
experiments  appeared  to  meet  these  criteria. 

2  Demonstration  of  Terrain  Table  Utility 

Any  final  judgment  as  to  the  effectiveness  of  this  experi¬ 
ment  in  meeting  this  objective  must  await  the  results  of 
the  SEEKVAL  IE  Experiment  (flight  tests  at  Fort  Lewis, 
Washington)  which  is  specifically  designed  to  determine 
the  validity  of  the  IB1  and  IB2  Experiments.  It  can  be 
stated  at  this  time  however,  that  the  IB1  results  do 
correlate  well  with  other  terrain  table  experiments  and 
flight  tests. 
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1.0  INTRODUCTION 

1 . 1  Background 

In  June  1972,  the  Director  of  Defense  Research  and  Engineering 
(DDR&E),  in  a  memorandum  to  the  Director,  Weapons  System  Evaluation  Group 
(WSEG) ,  pointed  out  the  need  for  a  coordinated  interservice  evaluation  of 
the  capabilities  of  acquiring  targets  during  Combat  Air  Support  missions. 3 
In  response,  WSEG  outlined  a  plan  for  determining  the  ability  of  observers 
to  acquire  ground  targets  from  both  fixed  and  rotary  wing  aircraft. 

The  resulting  program,  called  SEEKVAL,  was  divided  into  two 
phases.  Phase  I  was  limited  to  the  study  of  target  acquisition  from  fixed 
and  rotary  wing  aircraft  performing  Combat  Air  Support  missions  in  a  repre¬ 
sentative  Central  European  environment  under  daytime  visual  conditions. 
Phase  II  addressed  target  acquisition  from  the  same  types  of  aircraft  per¬ 
forming  the  same  missions  in  the  same  environment,  but  under  night  and 
adverse  weather  conditions . 

The  project  plan  for  Phase  I,  published  in  WSEG  report  196, 
outlined  a  series  of  experiments  to  evaluate  target  acquisition  systems  and 
techniques.  One  of  these  experiments  was  directed  toward  the  comparative 
evaluation  of  visual  and  aided-visual  acquisition  of  targets  under  labora¬ 
tory  conditions.  This  experiment,  entitled  Aided  Visual  Terrain  Table 
Experiments  (IB1),  was  further  defined  in  WSEG  report  230. 3  Basically  it 
involved  the  evaluation  of  the  ability  of  an  Observer  to  detect  and  acquire 
selected  target  models  arranged  on  a  terrain  table  by:  direct  viewing 
and/or  aided  viewing. 
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In  October  1974,  the  IB1  Project  Plan  was  published.  This 
plan  provided  a  detailed  description  of  the  five  sub-experiments  to  be  per¬ 
formed  to  satisfy  the  requirements  of  WSEG  reports  196  and  230.  As  set 
forth  in  the  IB1  Project  Plan,  the  specific  objective  of  the  terrain  table 
experiments  were  to : 


Combat  Air  Support  encompasses  Close  Air  Support  as  defined  in  a  joint 
memorandum  issued  by  the  Secretaries  of  the  Army  and  Air  Force  on  26 
March  1970. 

2 

WSEG  196,  "Operational  Test  and  Evaluation  of  the  Capability  to  Acquire 
Targets  in  Combat  Air  Support:  Description  of  Initial  Test  Program," 
(Comprising  IDA  Paper  P-911),  D.L.  Randall,  Insitute  for  Defense  Analyses, 
Arlington,  Va. ,  February  1973. 

3 

WSEG  230,  "Design  of  Aided  Visual  Terrain  Table  Experiments  for  Project 
SEEKVAL"  (Comprising  IDA  Paper  P-1016)  R.E.L.  Johnson  Jr.,  Institute  for 
Defense  Analysis,  Arlington,  Va. ,  April  1974. 
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"SEEKVAL  Project  Plan  IB1,  Aided  Visual  Terrain  Table  Experiment,"  LTC 
Dewey  C.  Yopp,  U.S.  Army,  Orlando,  Florida,  October  1974. 


1^  Determine  target  acquisition  performance  for  fixed  wing 
profile,  i.e.,  constant  altitude  and  speed,  for  visual 
search  aided  by  an  acquisition  sensor  when  compared  with 
direct  visual  search.  Controlled  variables  were  clutter, 
targe t-to-background  contrast,  and  illumination. 

1_  Determine  the  effects  of  different  numbers  of  targets  with 
variable  clutter  and  contrast  for  the  fixed  wing  aircraft 
profiles  for  aided  and  unaided  search. 

3^  Determine  effects  of  various  sun  angles  with  associated 
shadows  on  target  acquisition  performance  for  fixed  wing 
aircraft  for  aided  and  unaided  search. 

U_  Determine  target  acquisition  performance  for  rotary  wing 
aircraft  using  pop-up  tactics  for  visual  search  aided  by  an 
acquisition  sensor  when  compared  with  direct  visual  search. 
Controlled  variables  were  clutter,  contrast,  range  to  target, 
and  pop-up  altitude. 

5^  Determine  the  effects  of  target  and  background  coloration 
for  the  rotary  wing  profile  for  aided  and  unaided  search. 

6^  Generate  data  that  can  be  used  in  conjunction  with  field 
test  data  to  provide  an  evaluation  of  the  utility  of  the 
terrain  table  as  a  tool  in  the  evaluation  of  alternative 
target  acquisition  systems  and  techniques. 

The  Orlando  Division  of  the  Martin  Marietta  Corporation  was 
selected  to  conduct  the  IB1  portion  of  the  SEEKVAL  program.  To  ensure 
maximum  benefit  from  the  experiments,  the  devices  tested,  scenarios  adopted, 
and  procedures  used  at  the  Orlando  Division  were  kept  as  close  as  possible 
to  operational  reality.  Further,  the  conditions  chosen  and  data  recorded 
were  carefully  planned  to  provide  a  high  degree  of  correlation  with  the 
flight  test  validation  planned  as  a  subsequent  SEEKVAL  experiment. 

These  five  sub-experiments  were  designed  to  build  on  the  re¬ 
sults  of  the  direct  visual  terrain  table  and  target  imagery  experiments 
previously  conducted  as  part  of  the  SEEKVAL  program. ^ 

Generally,  the  objectives  of  the  five  individual  sub-experiments 
were  stated  in  terras  of  how  primary  and  secondary  factors  influence  target 
acquisition  performance  (range  at  -  or  time  to  -  target  acquisition, 2 
percentage  of  correct  targets,  and  number  of  incorrect  targets).  Specifi¬ 
cally,  the  objective  of  sub-experiment  1  was  to  provide  a  definitive  frame¬ 
work  for  the  examination  of  clutter/contrast  and  method  of  search, 3  and  for 
the  determination  of  their  effects  on  target  acquisition  performance.  The 
objective  of  sub-experiment  2  was  to  examine  the  effects  of  number  of  tar¬ 
gets  per  zone  on  target  acquisition  performance.  The  objective  of  sub¬ 
experiment  3  was  to  carry  out  an  in-depth  examination  of  angle  of  illumina¬ 
tion,  nominally  considered  in  sub-experiment  1,  and  to  determine  its  effect 


on  acquisition  performance.  Sub-experiments  1,  2,  and  3  employed  a  fixed- 
wing  profile. 


The  objective  of  sub-experiment  4  was  to  determine  the  effect 
of  clutter/contrast  on  acquisition  in  the  rotary  wing  flight  profile.  The 
object  of  sub-experiment  5  was  to  determine  the  relation  of  coloration  of 
target  and  background  to  the  acquisition  task  for  a  rotary  wing  profile. 

As  shown  in  Table  1-1,  method  of  search  was  a  prime  considera¬ 
tion  in  all  five  sub-experiments.  In  contrast,  while  the  effects  of 
clutter/contrast  were  measured  in  all  sub-experiments,  they  are  dominant 
only  in  1  and  4.  Each  of  the  other  factors  occurred  as  dominant  in  a 
specific  sub-experiment  designed  to  study  that  interaction. 


Experiment  IA1,  a  terrain  table  experiment  conducted  by  the  Aerospace 
Medical  Research  Laboratory  at  Wright  Patterson  AFB,  Ohio,  was  an  earlier 
SEEKVAL  experiment  which  explored  the  effects  of  sun  angle  on  the  target 
acquisition  process.  For  a  discussion  of  this  and  other  related 
experiments,  see  Appendix  C. 
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Target  acquisition,  as  used  in  Experiment  IB1,  combines  several  elements 
of  the  detection-recognition-identification  process.  The  test  Observers 
were  briefed  to  indicate  target  acquisition  when  they  were  sufficiently 
sure  of  the  target  to  be  willing  to  commit  ordnance  in  a  "free  fire" 
zone,  i.e.,  only  enemy  formations  are  present. 

3 

For  purposes  of  interpretation  of  the  method  of  search  data  presented  in 
this  report,  it  is  necessary  that  the  search  method  practices  in  these 
experiments  be  examined  in  the  light  of  the  first  objective  of  the  IB1 
program  as  stated  in  WSEG  Report  230  and  the  Project  Plan.  The  first 
objective  was  ".  .  .to  determine  the  relative  effectiveness  of  visual 
search  aided  by  an  acquisition  sensor  as  compared  with  direct  visual 
search  alone."  When  one  of  the  aids  was  called  for,  the  wording  of  the 
objective,  "visual  search  aided  by  an  acquisition  sensor"  necessitated 
leaving  the  Observer  the  option  of  using  direct  visual  search  or  the  aid 
at  his-  discretion.  The  mechanization  of  the  sensor  system  (as  required 
by  the  statement  of  work)  encouraged  direct  visual  search  followed  by 
sensor  examination  of  the  area  of  interest  and  the  briefings,  in  fact, 
recommended  this  procedure.  However,  the  Observer  could,  if  he  wished, 
use  visual  search  alone,  sensor  search  alone,  or  the  recommended  com¬ 
bination  of  the  two. 


TABLE  1-1.  OBJECTIVE  RANKING  BY  SUB-EXPERIMENT 


Factors 

1 

2 

3 

4 

5 

Method  of  search 

Primary 

Primary 

Primary 

Primary 

Primary 

Clutter 

Primary 

Secondary 

Secondary 

Primary 

Secondary 

Contrast 

Primary 

Secondary 

Secondary 

Primary 

- 

Illumination  angle 

Secondary 

- 

Primary 

- 

- 

No.  of  Targets/zone 

- 

Primary 

- 

- 

- 

Pop-up  range 

- 

- 

- 

Primary 

Secondary 

Pop-up  altitude 

- 

~ 

- 

Secondary 

- 

Target  and  background 
coloration 

Primary 

1.2  Laboratory  Configuration 

Experiment  IB1  was  conducted  in  the  Optical  Laboratory  of  the 
Guidance  Development  Center.  The  laboratory  was  configured  as  shown  in 
Figure  1-1. 


The  Observer  was  located  in  the  habitat  suspended  from  the 
lateral  carriage  and  horizontal  transporter  system  beam  which  was  used  to 
statically  position  the  habitat  in  latitude  and  altitude  for  each  run.  The 
construction  of  the  habitat  was  simple  and  functional.  The  interior  con¬ 
tained  an  aircraft  seat,  a  control  stick,  a  set  of  fixed  rudder  pedals  as 
foot  rests,  and  a  TV  monitor  mounted  in  an  instrumentation  panel.  Therefore, 
the  habitat  was  a  faithful  representation  of  an  aircraft  cockpit  only  to  the 
extent  necessary  to  provide  a  convincing  environment  for  the  Observer  and 
provide  for  his  safety.  No  attempt  was  made  to  duplicate  features  which  would 
task-load,  distract,  or  subject  the  Observer  to  stresses  beyond  those  imposed 
by  the  basic  acquisition  problem. 

A  tracker  gimbal  and  TV  camera  with  an  auto-focusing  lens  and 
zoom  was  mounted  above  the  Observer's  head.  The  computation  for  the  focus 
control  for  the  lens  system  was  done  on  one  of  the  analog  computers  using 
the  longitude,  latitude  and  altitude  positions  of  the  transporter  drives. 

The  tracker  gimbal  was  controlled  by  the  subject  wearing  a  helmet  sight  or 
by  a  control  stick  mounted  in  the  habitat. 

The  longitudinal  motion  or  range  closure  was  accomplished  by 
moving  the  40  foot  x  40  foot  terrain  model  on  its  rails.  The  velocity  of 
the  three  transporters  was  controlled  through  their  drive  systems  by  the 
analog  computer. 
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RUN  START  -  RESULTS 


Figure  1-1.  Laboratory  Configuration 


The  basic  terrain  and  vegetation  was  built  to  an  800:1  scale. 
Targets  and  clutter  elements  (trees,  shrubs,  etc.)  in  the  target  zones 
were  scaled  at  800:1  for  the  fixed  wing  experiments  and  200:1  for  the 
rotary  wing  experiments. 

The  area  was  similar  to  Fort  Lewis,  Washington,  and  was  repre¬ 
sentative  of  the  type  of  terrain  that  was  chosen  by  the  experiment.  Foliage 
was  thickest  at  the  higher  elevations  where  conifers  prevail.  At  the  lower 
elevations,  deciduous  trees  and  shrubs  predominated,  leaving  large  open 
areas.  Target  zones  were  evenly  divided  with  three  being  at  lower  eleva¬ 
tions  in  open  areas  and  three  at  higher  elevations  with  more  surrounding 
trees.  In  all  cases,  the  immediate  target  zone  was  cluttered  in  a  controlled 
manner  corresponding  to  the  manipulation  of  this  variable  in  the  experiments. 

The  target  tanks  were  scaled  to  800:1  and  200:1  to  provide  a 
contrast  and  color  set  for  each  target  location.  Paints  represented  clean 
O.D.,  dusty  O.D.,  and  patterned  camouflage. 

Depending  on  their  proximity  to  target  zones,  cultural  details 
such  as  buildings  and  roads  either  remained  at  the  basic  800:1  scale  or 
changed  to  200:1  as  required. 

In  the  course  of  the  experiments  it  was  necessary  to  vary 
target /background  contrast,  background  coloration,  clutter  density,  and 
number  of  targets.  Target /background  contrast  was  varied  primarily  by 
using  clean  O.D.  tanks  (high  contrast)  and  dusty  O.D.  tanks  (low  contrast). 
Where  photometric  measurements  indicate,  the  background  or  targets  were 
painted  to  produce  the  correct  contrast. 

Background  coloration  was  varied  by  painting.  Clutter  density 
was  varied  by  placing  additional  conifer  and  deciduous  vegetation  in  the 
clear  target  zones  and  removing  it  as  required.  Numbers  of  targets  were 
varied  by  adding  and  removing  tanks  of  the  correct  color  for  the  specific 
target  area,  at  the  required  contrast. 

An  Experimenter's  station  was  located  next  to  the  habitat 
which  allowed  the  Experimenter  to  control  and  observe  the  experiments.  His 
equipment  consisted  of  a  duplicate  TV  monitor,  program  display  and  keyboard 
system,  and  laboratory  control  panel. 

Terrain  model  lighting  was  provided  by  a  solar  simulator  pro¬ 
viding  500  foot-candles  and  supplemental  overhead  lighting  providing  up  to 
500  foot-candles  depending  on  the  experimental  illumination  conditions. 

Both  systems  provided  a  reasonable  match  to  sunlight  for  color  temperature. 

A  hybrid  computer  located  in  the  Computer  Room  provided  the 
computation.  An  analog  computer  provided  laboratory  computation  and  con¬ 
trol  while  the  digital  computer  provided  data  acquisition  and  reduction. 

Each  day,  prior  to  the  first  Observer's  arrival,  the  labora¬ 
tory  setup  was  validated  by  making  standardization  runs  to  check  the 
drives,  data  entry  and  recording,  habitat  system,  and  lighting. 
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During  a  run,  the  run  number  and  the  run  test  conditions  were 
displayed  to  the  Experimenter  and  test  conductor.  This  insured  that  the 
data  stored  on  digital  tape  by  the  computer  correctly  corresponded  to  the 
run  being  made.  The  data  from  each  run  was  then  sent  to  the  computer  for 
processing  and  print  out. 

Figure  1-2  shows  the  Optical  Laboratory  configured  for  SEEKVAL 
experiments.  Figure  1-3  shows  the  six  zones  used  on  the  terrain  table  for 
fixed  wing  experiments.  Figure  1-4  shows  the  four  zones  used  on  the  terrain 
table  for  rotary  wing  experiments.  A  detailed  description  of  the  Optical 
Laboratory  and  specialized  SEEKVAL  equipment  is  described  in  Appendix  B. 
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Figure  1-2.  Optical  Laboratory  Set-up 
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2.0 


SUB-EXPERIMENT  1 


» 


2.1  Objectives 

As  stated  in  the  IB1  Project  Plan  the  primary  objectives  of 

sub-experiment  1  were  to  determine  target  acquisition  performance  as  a 
function  of: 

1_  Search  method 

1_  Clutter  in  the  target  area 

_3  Targe t-to-background  contrast. 

The  secondary  objective  was  to  determine  target  acquisition 
performance  as  a  function  of  illumination  angle. 

2.2  Experimental  Design 

Sub-experiment  1,  diagrammed  in  Figure  2-1,  examined  in  detail 
the  performance  of  four  search  methods  under  six  different  conditions  of 
varying  clutter/contrast  combinations.  Effects  of  terrain  table  location 
on  performance  were  evaluated  by  replicating  the  six  combinations  of  clutter/ 
contrast  through  the  six  target  zones,  resulting  in  six  table  configura¬ 
tions.  The  four  search  methods  used  were: 

_1  Direct  visual  search  without  sensor  aids 

2_  Direct  visual  search  in  parallel  with  search  using  a  tele¬ 
vision  sensor  with  a  narrow  (2  degrees)  field-of-view  (NF) 

3^  Direct  visual  search  in  parallel  with  search  using  a  tele¬ 
vision  sensor  with  a  wide  (8  degrees)  FOV  (WF) 

<*_  Direct  visual  search  in  parallel  with  search  using  a  tele¬ 
vision  sensor  using  variable  FOV  (zoom  lens,  8  to  2  degrees) 
(VF) . 

In  all  four  search  modes  the  Observer  wore  the  Honeywell  MOVTAS 
Helmet  Sight.  Unless  the  Observer  selected  track  stick  control,  the  helmet 
sight  provided  steering  commands  to  the  sensor  gimbal.  The  Experimenter's 
TV  display  provided  continuous  sensor  look  angle  information  allowing  the 
Experimenter  to  determine  the  Observer's  look  angle.  The  Observer's  TV 
display  was  disabled  when  the  direct  view  method  of  search  was  called  for. 

Two  Observers,  one  trained  and  one  untrained,  ran  identical 
run  sets  giving  a  total  of  1152  experimental  runs.  One  run  was  not  com¬ 
pleted.  Inter-subject  variability  within  the  groups  is  not  known. 

(6  table  configurations)  x  (4  search  modes)  x 
(6  clutter/contrast  conditions)  x  (4  illumination 
conditions)  x  (2  Observers  running  identical  runs)  = 

1152  experimental  runs. 
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FACTORS  CONSIDERED 

METHOD  OF  SEARCH  -  4  TYPES 
CLUTTER  -  3  LEVELS 
CONTRAST  -  2  LEVELS 
ILLUMINATION  -  4  LEVELS 

OBSERVERS  REQUIRED 

32  FOR  EACH  OF  6  CONFIGURATIONS 
OF  THE  TABLE 

MEASURES  OF  EFFECTIVENESS 
RANGE  AT  ACQUISITION 
PERCENT  OF  TARGETS  ACQUIRED 
NUMBER  OF  FALSE  ACQUISITIONS 

NUMBER  OF  TARGETS 
3  PER  AREA 

NUMBER  OF  EXPERIMENTAL  RUNS 

(96  CELLS)  x  (6  TABLE  CONFIGURATIONS)  x 
(2  OBSERVERS  RUNNING  IDENTICAL  RUN-SETS) 
=1152  EXPERIMENTAL  RUNS 


Figure  2-1.  Design  of  Sub-experiment  1 
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2.3 


Hypotheses 


Prior  to  the  experiment,  the  following  hypotheses  relative 
to  sub-experiment  1  were  postulated  (reference  Project  Plan  IB1  of  October 
1974,  Annex  K,  section  5). 

Clutter  will  affect  target  acquisition  in  the  order  of  best 
acquisition  to  worst  as  low,  medium,  and  high 

2_  High  contrast  will  produce  better  target  acquisition  than 
low  contrast 

3^  Clutter  will  interact  with  contrast  such  that  medium  and 
high  clutter  conditions  will  differentially  degrade  target 
acquisition;  at  equivalent  levels  of  contrast  target  acqui¬ 
sition  will  be  lower  with  clutter 

4^  Effects  of  shadow  will  act  to  increase  the  effects  of 
clutter;  at  low  clutter  condition  shadow  will  aid  target 
acquisition;  at  high  clutter  conditions  shadow  will  reduce 
target  acquisition  performance 

5^  Overcast  illumination  will  not  interact  significantly  with 
clutter  or  contrast 

6^  Sun  angle  will  improve  target  acquisition  when  it  cause's  shad¬ 
ow  to  increase  the  lateral  size  of  the  target;  target  acqui¬ 
sition  performance  will  be  better  at  90  degrees  sun  angle 
than  at  0  or  180  degrees;  45  and  135  degrees  sun  angles  will 
be  better  than  0  or  180  degrees  but  less  than  90  degrees. 

2.4  Method  of  Accomplishment 

2.4.1  General  Description 

Each  of  the  four  search  methods  was  used  by  different  Observers 
against  targets  positioned  on  the  terrain  table. 

The  habitat  was  brought  to  the  simulated  altitude  (3000  ft) 
and  fixed  in  position.  The  run  was  started  by  the  Experimenter  at  which 
time  the  curtain  was  raised  and  the  terrain,  starting  at  a  slant  range  of 
13  km,  moved  under  the  cockpit  to  simulate  a  flight  velocity  of  approxi¬ 
mately  400  knots.  Each  Observer  made  six  separate  runs.  Each  run  posed  a 
different  search  situation  of  clutter /contrast,  while  the  illumination  was 
maintained  constant.  The  Experimenter  monitored  the  Observer's  search  on  the 
TV  monitor  at  his  station.  Each  run  ended  when  the  Observer  signaled  ac¬ 
quisition. 
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The  instant  that  the  Observer  signaled  acquisition,  a  curtain 
came  down  in  front  of  him  and  the  sensor;  the  range  and  time  of  the  acquisi¬ 
tion  were  recorded.  The  terrain  and  habitat  were  repositioned  for  the  next 
run.  Alternatively,  the  run  was  stopped  by  the  Experimenter  when  the  Ob¬ 
server  had  overflown  his  target. 

At  the  end  of  each  of  the  six  runs,  the  Experimenter  asked 
the  Observer  questions  about  the  target  (location,  number,  color,  and 
direction)  to  verify  correct  acquisition.  This  information  was  recorded 
on  the  Experimenter  Check  Sheet  and  also  entered  into  the  computer  through 
the  use  of  the  keyboard.  Then  the  next  run  began. 

The  presence  and  positions  of  the  sun  simulator  resulted  in 
distinct  changes  in  subject  handling  procedures  in  order  to  provide  effi¬ 
cient  experimentation. 

1.  On  all  overcast  sky  runs,  each  Observer  was  processed 
through  targets  1  to  6,  in  order,  and  released 

The  sun  simulator  at  azimuth  135  degrees  and  180  degrees 
required  a  change  of  the  simulator  from  one  side  of  the 
model  to  the  other  during  the  run.  This  proved  to  be  very 
time  consuming.  Several  changes  in  sequence  were  attempted 
but  the  problem  remained.  Therefore,  starting  with  terrain 
table  configuration  C,  the  straight-through  order  was  re¬ 
stored  for  all  sun  positions  and  compensation  was  made  by 
batching  the  Observers.  For  azimuths  of  135  degrees  and 
180  degrees,  a  batch  of  four  Observers  was  taken  through 
1-2-3,  the  sun  simulator  unit  was  repositioned,  and  the 
batch  was  put  through  4-5-6.  For  azimuth  90  degrees 
this  batch  sequence  became  1  -  2  -  SC*  -3-  SC  -4-5- 
SC  -  6.  These  actions  maintained  the  proper  order  and 
saved  time. 

2.4.2  Observers 

Observer  selection  for  sub-experiment  1  consisted  of: 

96  Martin  Marietta  (untrained  Observers) 

53  Air  Force 
31  Navy 
12  Marines 
192 


*Solar  simulator  position  charge 


These  runs  were  made  from  9  December  1974  to  21  January  1975. 
One  Martin  Marietta  Observer  did  not  complete  his  sixth  run  due  to  equip¬ 
ment  failure. 

2.4.3  Terrain  Table  Layout 

Sub-experiment  1  used  terrain  table  configurations  A,  B,  C, 

D,  E,  and  F.  Each  configuration  was  divided  into  six  separate  target  zones. 
Each  zone  represented  a  different  combination  of  clutter/contrast.  These 
combinations  were  rotated  through  the  zones  in  the  six  configurations  as 
shown  in  Table  2-1. 


TABLE  2-1.  CLUTTER/CONTRAST  COMPOSITION 
OF  CONFIGURATIONS  A  THROUGH  F 


Target 

Zone 

A 

B 

C 

D 

E 

F 

I 

LL 

HH 

MH 

LH 

■s 

ML 

II 

ML 

LL 

HH 

Bfl 

HL 

III 

HL 

ML 

LL 

HH 

LH 

IV 

LH 

HL 

ML 

LL 

HH 

MH 

V 

MH 

LH 

HL 

ML 

LL 

HH 

VI 

HH 

MH 

LH 

HL 

ML 

LL 

Clutter  was  classified  as  either  low,  medium,  or  high.  The 
levels  of  clutter  were  defined  in  terms  of  the  number  of  target-like  objects 
in  the  immediate  vicinity  of  the  target  —  low  clutter  was  represented  by 
no  trees  in  a  200  meter  radius  circle  about  the  target;  medium  by  20  trees; 
and  high  by  60  trees. 

The  contrast  of  the  individual  targets  with  respect  to  their 
backgrounds  took  two  levels:  a  low-contrast  case  in  which  the  targets 
were  only  slightly  darker  than  the  background;  and  a  high-contrast  case, 
in  which  targets  were  considerably  darker  than  the  background. 


Two  different  colors  were  used  for  the  tank  targets:  dark  O.D. 
(high  contrast)  and  beige  (low  contrast).  These  two  colors  served  through¬ 
out  the  experiment,  providing  contrasts  within  the  required  tolerances, 
since  the  terrain  table  surface  (background)  was  fairly  homogeneous.  Con¬ 
trast  was  defined  as  the  difference  between  the  luminances  of  the  target 
and  background  divided  by  the  luminance  of  the  background,  i.e.,  C  =  (L^  - 
LB)/Lg.  Table  2-II  summarizes  the  average  contrast  of  the  three  target  tanks 
with  respect  to  the  background  in  each  target  zone  for  each  of  the  table 
configurations . 


TABLE  2-II.  NEGATIVE  CONTRAST  RATIO  OF  THE  TARGETS 
IN  THE  DIFFERENT  TARGET  ZONES 
FOR  CONFIGURATIONS  A  THROUGH  F 


Target 

Zone 

Table 

A 

B 

C 

D 

E 

F 

I 

0.38 

0.69 

0.81 

0.77 

0.36 

0.31 

II 

0.23 

0.22 

0.84 

0.80 

0.77 

0.38 

III 

0.38 

0.38 

0.38 

0.82 

0.77 

0.82 

IV 

0.71 

0.37 

0.34 

0.42 

0.77 

0.78 

V 

0.64 

0.64 

0.30 

0.28 

0.27 

0.71 

VI 

0.67 

0.65 

0.84 

0.23 

0.35 

0.27 

2.4.4  Illumination  Conditions 

Uniform  lighting  characteristics  of  overcast  weather,  as  well 
as  directional  lighting  characteristics  of  sunlight  were  simulated.  Over¬ 
cast  weather  was  simulated  using  overhead  fluorescent  lighting  producing 
500  foot-candles  at  the  terrain  table  surface.  Clear  sky  weather  was 
simulated  using  the  sun  simulator  (also  producing  500  foot-candles  at  the 
surface)  to  provide  the  different  angles  of  illumination.  Overhead  fluo¬ 
rescent  lighting  (producing  100  foot-candles)  provided  the  diffuse  skylight 
effect . 


Sub-experiment  1  used  four  different  illumination  conditions 
as  shown  in  Table  2-III. 


TABLE  2-III .  ILLUMINATION  CONDITIONS 


Elevation 

40  degrees 

40  degrees 

2 

40  degrees 

3 

90  degrees 

Azimuth^ 

90  degrees 

180  degrees 

135  degrees 

- 

Azimuth  (Az)  is  the  direction  of  the  sunlight  taken  from  the  position 
of  the  Observer,  i.e.,  180  degrees  case,  the  Observer  is  looking 
into  the  sun. 

Due  to  equipment  limitations,  target  zones  I  and  IV  for  the  El  40, 

Az  135  cases  were  run  at  an  actual  elevation  of  32  degrees. 

Overcast  sky  conditions 
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2.4.5 


Measures  Used 


For  each  individual  run,  the  range  and  time  of  acquisition 
were  recorded;  valid  as  well  as  false  acquisitions,  and  failures  to  acquire 
targets  were  also  recorded. 

2.5  Results 

Two  working  procedures  were  used  in  the  analysis  of  the  data  for 
sub-experiment  1: 

_1  Any  correct  acquisition  made  at  the  proper  location  was  con¬ 
sidered  valid,  regardless  of  how  many  tanks  were  reported 
at  that  location.  Thus,  when  an  Observer  reported  one,  two, 
three,  or  more  tanks  at  a  proper  location  this  was  recorded 
as  a  valid  target  acquisition.  Only  valid  acquisitions 
were  considered  in  the  statistical  computations. 

2^  All  data  reporting  mean  range  and  the  standard  deviations 
thereof  are  based  on  the  number  of  acquisitions  made,  and 
do  not  include  unsuccessful  acquisition  attempts. 

Results  from  sub-experiment  1  indicate  that  clutter  was  the 
most  significant  factor  influencing  target  acquisition  performance.  In  this 
experiment,  439  acquisitions  were  made  out  of  1151  attempts.  Each  of  the 
192  Observers  made  six  runs,  except  for  one  Observer  who  missed  one  run  due 
to  equipment  failure. 

2.5.1  Analysis  of  Variance  (General  Linear  Model) 

The  General  Linear  Model  (GLM)/BMD10V  (see  Appendix  D)  was  used 
to  generate  estimates  for  the  missing  cells  for  the  analysis  of  variance 
(ANOVA).  Results  of  the  ANOVA  are  shown  in  Table  2-IV.  Main  effects  and 
two-way  interactions  are  included  in  the  generated  model.  At  the  .05  level 
of  significance,  the  main  effects  of  terrain  table  (that  is,  variance  in  the 
terrain  table  configuration)  and  clutter  and  the  two-way  interactions  of 
Observers  versus  terrain  tables,  terrain  tables  versus  clutter,  and  illumi¬ 
nation  condition  versus  search  method  are  significant.  To  test  the  impact 
of  these  effects,  additional  one-  and  two-way  ANOVA  were  performed  to  help 
determine  whether  the  differences  could  be  more  precisely  located.  These 
one-  and  two-way  ANOVA  were  conducted  using  the  actual  recorded  data  and  did 
not  include  BMD10V  generated  values.  Thus,  these  analyses  are  probably  more 
representative  of  the  actual  reported  data.''- 


It  should  be  noted  as  in  Appendix  D,  paragraph  1.3,  that  the  GLM,  when 
implemented  as  the  BMD10V  program,  loses  creditability  of  estimated  values 
when  the  data  cells  to  be  filled  are  grouped  as  a  function  of  one  or  more 
variables.  In  the  case  of  sub-experiment  1,  unfilled  cells  are  strongly 
grouped  by  clutter  and  search  method. 


TABLE  2- IV.  SUB-EXPERIMENT  1  ANOVA 
(GENERAL  LINEAR  MODEL) 


Source 

Sum  of  Squares 

Degrees 

of 

Freedom 

Mean  Square 

F  Ratio 

Table 

36925575.35 

5 

7385115.07 

2.43117* 

Illumination  Angle 

12899474.87 

3 

4299824.95 

1.41550 

Assigned  Search  Method 

10490307.46 

3 

3496769.15 

1.15113 

Observer 

2377955.80 

1 

2377955.80 

0.78282 

Clutter 

51642141.49 

2 

25821070.74 

8.50027* 

Contrast 

9828578.45 

1 

9828578.45 

3.23556 

Table /Illumination  Angle 

72242298.42 

15 

4816153.22 

1.58547 

Observer /Table 

59696909.58 

51 

1939281.91 

3.93043* 

Table/Clutter 

83173370.14 

10 

8317337.01 

2.73806* 

Illumination  Angle/ 
Assigned  Search  Method 

62897861.68 

9 

6988651.29 

2.30066* 

Observer/ Illumination 
Angle 

10623872.70 

3 

3541290.90 

1.16579 

Illumination  Angle/ 
Clutter 

33750618.79 

6 

5625103.13 

1.85178 

Observer / Ass igned 

Search  Method 

21339572.67 

3 

7113190.89 

2.34165 

Assigned  Search  Method/ 
Contrast 

13082226.67 

3 

430742.22 

1.43555 

Observer/ Contrast 

9776759.75 

1 

9776759.75 

3.21850 

Clutter /Contrast 

9029139.36 

2 

4514569.68 

1.48619 

Error 

1111790098.22 

366 

3037677.00 

*Significant  at  .05  level 
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2.5.2  Primary  Objectives 

2. 5. 2.1  Search  Method 

The  data  for  search  method  must  be  considered  in  two  ways: 
first  in  terms  of  the  assigned  method,  and  second  in  terms  of  the  actual 
method  used.  In  the  runs  using  terrain  table  configurations  A  and  B,  the 
actual  method  of  search  used  by  the  Observer  was  not  always  recorded  by 
the  Experimenter  after  each  run.  This  procedure  was  followed  explicitly 
on  all  runs  after  terrain  table  configuration  B  was  complete.  Some  of  the 
actual  search  method  data  was  also  available  from  Experimenter  Logs  for 
table  configurations  A  and  B.  However,  any  run  in  which  the  search  method 
was  not  clearly  recorded  was  not  used  in  the  analyses. 

2. 5. 2. 1.1  Assigned  Search  Method 

The  ANOVA  indicated  no  significant  difference  among  assigned 
search  methods  (Table  2-V) .  The  direct  view  (DV)  and  wide  field  of  view 
(WF)  appear  to  be  essentially  the  same,  while  the  narrow  (NF)  and  variable 
(VF)  field  of  view  conditions  are  alike.  The  result  of  a  chi-square  test 
of  the  number  of  acquisitions  by  assigned  search  method  is  not  significant 


TABLE  2-V.  ASSIGNED  SEARCH  METHOD 

(NO  SIGNIFICANT  DIFFERENCE 
F(3, 366)  =  1.41) 


Assigned  Search 
Method 

Mean 

Range  (x) 

Standard 

Deviation 

(S) 

Sample 
Size  N 

DV 

4349m 

1726 

115 

DV  +  NF 

4922m 

2012 

104 

DV  +  WF 

4436m 

1976 

113 

SV  +  VF 

4947m 

2196 

107 

2 

Chi-square  (x  =  1.16,  DF  =  3)  Not  significant 


The  ANOVA  presented  in  Tab’e  2-IV  indicated  an  interaction  be 
tween  the  illumination  angle  and  the  assigned  search  method.  Table  2-VI 
presents  the  two-way  ANOVA  for  illumination  angle  versus  assigned  search 
method.  Table  2-VII  shows  the  mean  detection  ranges  for  the  combinations 
of  assigned  search  method  and  illumination  angle.  There  is  not  a  predict¬ 
able  pattern  for  the  assigned  search  methods. 
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TABLE  2 -VI .  ANOVA  ILLUMINATION  ANGLE 

VERSUS  ASSIGNED  SEARCH  METHOD 


Source 

Sum  of  Squares 

Degrees  of 
Freedom 

Mean  Square 

F  Ratio 

Illumination  Angle 

25217852.85 

3 

8405950.95 

2.24 

Search  Method 

34662082.70 

3 

11554027.56 

3.08* 

Illumination  Angle  X 
Search  Method 

93572194.57 

9 

10396910.50 

2.77* 

Error 

1589335402.32 

423 

3757294.09 

*Significant  at  .05  level 


TABLE  2-VII .  INTERACTION  OF  ASSIGNED  SEARCH  METHOD 
VERSUS  ILLUMINATION  ANGLE 


Assigned  Search 
Method 

Illumination  Angle 

180 

Degrees 

135 

Degrees 

90 

Degrees 

Overcast 

DV 

4062m 

4635m 

4772m 

3879m 

DV  +  WF 

3735m 

3990m 

5010m 

4859m 

DV  +  NF 

5872m 

4122m 

5168m 

4758m 

DV  +  VF 

5832m 

4442m 

„ _ 

4611m 

4720m 

2. 5. 2. 1.2  Actual  Search  Method  (terrain  table  configurations  C,  D,  E, 
and  F  Only) 

Table  2-VIII  lists  the  results  of  the  ANOVA  for  the  actual 
search  method  as  well  as  for  the  illumination  angle  interaction  effects, 
which  were  shown  as  significant  in  Table  2-IV.  Only  the  actual  method  of 
search  is  significant  at  the  .05  level;  there  was  no  significant  inter¬ 
action  between  actual  search  method  and  illumination  angle. 
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TABLE  2 -VIII .  ACTUAL  SEARCH  METHOD  VERSUS 


ILLUMINATION  ANGLE  (TERRAIN 
TABLES  C,  D,  E,  AND  F  ONLY) 


Source 

Sum  of  Squares 

Degrees  of 
Freedom 

Mean  Square 

F.  Ratio 

Search  Method 

32776679.20 

3 

10925559.73 

3.28* 

Illumination  Angle 

6461300.31 

3 

2153766.77 

0.65 

Search  Method  X 
Illumination  Angle 

46525221.38 

9 

5169469.04 

1.55 

Error 

969364286.16 

291 

3331148.74 

*Significant  at  .05  level 


Table  2-IX  presents  the  actual  search  method  data.  The  wide 
field  had  the  longest  range,  followed  closely  by  the  variable  field.  The 
use  of  the  narrow  field,  and  direct  visual  methods  produced  acquisitions 
at  markedly  shorter  ranges.  As  shown  by  the  data,  there  was  little  differ 
ence  in  operator  preference  among  the  three  sensors;  however,  the  direct 
view  was  selected  by  a  plurality  of  the  Observers. 


TABLE  2-IX.  ACTUAL  SEARCH  METHOD 

(SIGNIFICANT  DIFFERENCE 
F(3,291)  =  3.28) 


Assigned  Search 
Method 

Mean 

Range  (x) 

Acquisitions 

Misses 

DV 

4401m 

130 

213 

DV  +  NF 

4559m 

55 

87 

DV  +  WF 

5189m 

56 

66 

DV  +  VF 

4942m 

66 

95 

2 

Chi-square  (x  =  2.56,  D^  =  3)  Not  significant 
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2. 5. 2. 2 


Clutter 


As  indicated  in  Table  2-1V,  the  effect  of  clutter  was  signifi¬ 
cant  at  the  .05  level.  The  high  level  of  clutter  produced  the  shortest  acqui 
sition  range  and  the  low  level  the  longest.  Also  the  chi-square  test  of  the 
number  of  acquisitions  showed  a  significant  difference;  as  the  level  of 
clutter  increased  the  number  of  acquisitions  descreased.  These  results  are 
shown  in  Table  2-X. 


TABLE  2-X.  EFFECT  OF  CLUTTER  (SIGNIFICANT 
DIFFERENCE  F(2,366)  =  8.50) 


Clutter 

Level 

Mean 

Range 

(x) 

Standard 

Deviation 

(o) 

1 

Low 

5016m 

2114 

226 

Medium 

4410m 

1773 

125 

High 

4064m 

1777 

88 

Chi-square  (x^  =  102.8,  DF  =  2)  Significant 


2.5.2. 3  Contrast 

The  ANOVA  presented  in  Table  2-IV  using  the  GLM  did  not  show 
contrast  to  be  a  significant  factor  although  the  high  level  of  contrast 
showed  a  slightly  longer  acquisition  range.  Also  no  significance  resulted 
from  the  chi-square  test  on  the  number  of  acquisitions.  (More  targets 
were  found  at  the  low  level  of  contrast.)  Table  2-XI  shows  the  results 
from  the  two  levels  of  contrast. 


TABLE  2-XI.  EFFECT  OF  CONTRAST  (NO  SIGNIFICANT 
DIFFERENCE  F(l,366)  =  3.24) 


Mean 

Standard 

Contrast 

Range 

Deviation 

Level 

(x) 

(n) 

(N) 

Low 

4508m 

1931 

242 

High 

4831m 

2055 

197 

Chi-square  (x^  =  7.125,  DF  =  1)  Not  significant 
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2.5.3  Secondary  Objectives 

2. 5. 3.1  Illumination 

As  analyzed  through  the  GLM  (Table  2- IV),  illumination  angle 
had  no  significant  effect  on  acquisition  range;  however,  based  on  the  chi- 
square  test,  illumination  angle  did  influence  the  number  of  acquisitions. 
The  overcast  and  90  degree  conditions  produced  more  acquisitions  than  the 
135  and  180  degree  conditions.  Table  2-XII  shows  the  mean  range,  standard 
deviation,  and  number  of  acquisitions  for  various  illumination  conditions. 


TABLE  2-XII.  ILLUMINATION  RESULTS 
(NO  SIGNIFICANT 
DIFFERENCE 
F(3, 366)  =  1.41) 


Sun  Azimuth 

Mean 

Range 

(50 

Standard 

Deviation 

(a) 

Sample 

Size 

(N) 

Overcast 

4546m 

1902 

120 

180 

4821m 

2308 

97 

135 

4274m 

1762 

89 

90 

4879m 

1944 

133 

Chi-square  (x^  ■  18.2,  DF  -  3) 
Significant 


2.5.4  Additional  Results 

2. 5. 4.1  Terrain  Table  Configurations 

The  effects  of  terrain  table  configurations  are  significant 
as  shown  in  Table  2-IV. 

Table  2-XIII  presents  the  results  of  the  analysis  of  the  six 
table  configurations.  The  chi-square  test  also  indicated  a  significant 
difference  in  the  number  of  acquisitions  by  terrain  table  configuration. 
This  is  partially  due  to  a  change  in  briefing  level,  which  is  discussed  in 
section  2. 5. 4. 3. 
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TABLE  2 -XIII .  TERRAIN  TABLE  CONFIGURATION  RESULTS 

(SIGNIFICANT  DIFFERENCE  F(5,366)  =  2.43) 


Configuration 

Mean 

Range 

(x) 

Standard 

Deviation 

Co) 

WB 

A 

4682m 

2460 

66 

B 

4452m 

2076 

66 

C 

4083m 

1870 

54 

D 

4464m 

1933 

96 

E 

4898m 

1613 

93 

F 

5238m 

1925 

64 

Differences 

Configuration 

B 

C 

D 

E 

F 

A 

NS 

NS 

NS 

NS 

mm 

B 

■  '  . 

NS 

NS 

NS 

C 

- 

NS 

* 

D 

- 

■ 

NS 

Bill 

E 

.  1 

- 

■ 

- 

NS 

F 

- 

- 

NS  =  Not  Significant 
*  =  Significant 


Chi-square  (x^  =  32.4,  DF  =  5)  Significant 


The  ANOVA  in  Table  2-IV  shows  a  significant  interaction  be¬ 
tween  clutter  and  terrain  table  configurations.  A  two-way  ANOVA  for  these 
factors  is  shown  in  Table  2-XIV. 

Table  2-XV  shows  the  effects  on  mean  acquisition  range  of 
clutter  and  terrain  table  configuration.  The  effect  of  clutter  followed 
the  expected  pattern  in  terrain  table  configurations  A,  D,  E,  and  F;  that 
is,  the  higher  the  clutter  the  shorter  the  detection  range,  although  table 
configuration  E  produced  no  great  difference  in  ranges.  In  table  configura 
tion  B,  the  expected  pattern  was  reversed;  that  is,  the  highest  clutter  pro 
duced  the  longest  detection  range  and  the  lowest  clutter,  the  shortest  de¬ 
tection  ranges.  In  table  configuration  C,  the  medium  level  of  clutter  pro¬ 
duced  the  longest  detection  ranges,  although  they  were  not  significantly 


different  from  those  achieved  with  the  low  clutter  level. 


TABLE  2-XIV.  ANOVA  TERRAIN  TABLE  VERSUS  CLUTTER 


Source 

Sum  of  Squares 

Degrees  of 
Freedom 

Mean  Square 

F  Ratio 

Terrain  Table 
Configuration 

43487456.13 

5 

8697491.22 

2.43* 

Clutter 

45060919.84 

2 

22530459.92 

6.30* 

Table  Configura¬ 
tion  X  Clutter 

110731404.31 

10 

11073140.43 

3.10* 

Error 

1005197346.43 

421 

3575290.60 

*Significant  at  the  .05  level 


TABLE  2-XV.  CLUTTER  BY  TERRAIN  TABLE 
CONFIGURATION 


Configuration 

Clutter 

Low 

Medium 

High 

A 

5883m 

3883m 

3177m 

B 

4135m 

4497m 

5609m 

C 

4226m 

4403m 

3519m 

D 

5115m 

4030m 

3604m 

E 

4981m 

4823m 

4791m 

F 

5753m 

5026m 

4233m 

The  effects  of  clutter  and  contrast  were  also  analyzed  by  the 
number  of  correct  acquisitions  by  terrain  table  configurations.  Table  2-XVI 
shows  the  results  for  clutter,  while  Table  2-XVII  shows  the  results  for  con¬ 
trast.  At  the  .05  level,  the  chi-square  test  showed  no  significant  differ¬ 
ence  for  the  totals  in  either  clutter  or  contrast. 


TABLE  2 -XVI.  EFFECTS  OF  CLUTTER 

ON  ACQUISITIONS 


Clutter 

Chi-Square 

Degrees 

Low 

Medium 

High 

Freedom 

32 

18 

B 

10.5 

2* 

39 

17 

31.7 

2* 

28 

12 

14 

11.8 

2* 

45 

34 

17 

24.9 

2* 

47 

30 

16 

30.2 

2* 

35 

14 

15 

19.7 

2* 

Chi-square  (y^  =  8.72,  DF  =  10)  Not  Significant 
*Significant  at  the  .05  level. 


TABLE  2 -XVI I .  EFFECTS  OF  CONTRAST 
ON  ACQUISITIONS 


Configuration 

Contrast 

Chi-Square 

Low 

High 

A 

34 

32 

0.023 

B 

35 

31 

0.208 

C 

29 

25 

0.232 

D 

58 

38 

7.52 

E 

53 

40 

3.00 

F 

33 

31 

0.023 

Chi-square  (y2 

=  2. 

06,  DF 

=  5)  Not  Si 

Degrees 

of 


*Signif leant  at  the  .05  level. 


Examining  clutter  within  terrain  table  configurations  showed 
that  the  effect  of  clutter  is  significant  for  all  configurations.  However 
only  terrain  table  configuration  D  showed  a  significant  inverse  differ¬ 
ence  for  contrast.  In  terrain  table  configurations  D  and  E,  more  targets 
were  detected  at  the  low  level  of  contrast  while  for  the  other  four  con¬ 
figurations  the  number  of  acquisitions  were  essentially  the  same  for  both 
levels  of  contrast. 


2. 5. 4. 2 


Observer  Differences 


There  were  no  significant  differences  in  Observer  range  perform¬ 
ance  as  indicated  in  the  ANOVA  (Table  2-IV) .  The  result  of  a  chi-square 
test  of  number  of  correct  targets  for  trained  versus  untrained  Observers 
is  significant  with  the  trained  observers  identifying  23  percent  more  targets. 
The  trained  Observers  acquired  more  targets,  but  their  mean  range  was  not 
significantly  different  from  that  of  the  untrained  Observers.  Table  2-XVIII 
presents  the  data  for  the  Observers . 


TABLE  2-XVIII.  OBSERVER  RESULTS 
(NOT  SIGNIFICANT 
F(l,366)  =  0.78) 


Observers 

Range 

Mean 

(*) 

Standard 
Deviat ion 

(5) 

Sample 

Size 

(N) 

Untrained 

4714m 

1989 

197 

Trained 

4603m 

1997 

242 

Chi-square 

(x2  " 

7.12,  DF  * 

1) 

Significant 


The  ANOVA  did  indicate  an  interaction  of  Observers  with  terrain 
table  configurations.  In  terrain  table  configurations  B,  C,  and  F  the  un¬ 
trained  Observers  acquired  targets  at  greater  ranges  but  the  trained  Ob¬ 
servers  acquired  more  targets.  In  table  configurations  D  and  E,  the  trained 
Observers  performed  better  all  around,  while  in  table  configuration  A  there 
was  no  significant  difference  between  the  trained  and  untrained  Observer. 

The  chi-square  test  of  the  number  of  correct  targets  by  table  configuration 
for  trained  versus  untrained  Observers  was  not  significant.  Table  2-XIX 
shows  these  data. 

2. 5. 4. 3  Briefing  Level 

Briefing  level  was  not  originally  planned  as  a  variable,  but 
analysis  of  the  results  of  table  configuration  A  made  it  obvious  that  the 
briefing  used  was  inadequate.  Subjects  were  briefed  initially  to  a  3-square 
kilometer  area  but  the  rate  of  acquisition  was  too  low  to  provide  enough 
data  on  which  to  base  statistically  valid  results,  A  recommendation  was 
made  to  the  SEEKVAL  Program  Office  to  change  the  briefing  level  to  a  1- 
square  kilometer  level  halfway  through  the  experiment.  Upon  approval,  this 
change  was  made  at  the  end  of  terrain  table  configuration  C.  Results  of  the 
change  of  briefing  are  shown  in  Tables  2-XX  and  2-XXI.  The  1-square  kilo¬ 
meter  briefing  level  improved  performance  in  number  of  acquisitions  for 
terrain  table  configurations  D  and  E  but  not  for  E. 
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TABLE  2 -XIX.  TARGET  ACQUISITION  BY  TERRAIN 
TABLE  CONFIGURATION 


Experience 

Untrained 

Trained 

Totals 

Configuration 

Mean 

Range 

(x) 

Sigma 

(9) 

N 

Mean 

Range 

<x) 

Sigma 

(9) 

N 

Mean 

Range 

(x) 

Sigma 

(9) 

N 

A 

4688m 

210i 

34 

4675m 

2824 

32 

4682m 

2460 

66 

B 

5039m 

2174 

31 

3932m 

1865 

35 

4452m 

2076 

66 

C 

4899m 

2105 

19 

3639m 

1590 

35 

4083m 

1870 

54 

D 

4390m 

2118 

47 

4533m 

1756 

49 

4464m 

1933 

96 

E 

4204m 

1216 

44 

5520m 

1682 

49 

4898m 

1613 

93 

F 

5846m 

2060 

22 

4920m 

1793 

42 

5238m 

1925 

64 

Total 

4714m 

1989 

197 

4603m 

1997 

242 

4653m 

1992 

439 

Chi-square  (x^  =  7.07,  DF  =  5)  Not  significant 


TABLE  2 -XX. 

BRIEFING  LEVEL 

Configuration 

Acquisitions 

Miss 

A,  B,  C 

186 

390 

D,  E,  F 

253 

323 

Chi-square  (x^ 

=  21.1,  DF  = 

1) 

Significant 

TABLE  2 -XXI .  EFFECT  OF  BRIEFING  LEVEL 
ON  ACQUISITION 


3' 


2.6 


Conclusions 


In  sub-experiment  1  only  439  of  1151  acquisition  attempts  were 
successful.  Therefore,  the  results  of  the  analysis  of  variance  must  be 
viewed  with  caution.  More  emphasis  should  be  put  on  the  results  of  the 
analysis. 

2.6.1  Method  of  Search 

The  primary  objective  of  sub-experiment  1  of  the  IB1  experi¬ 
ment  was  to  compare  effectivity  of  direct  visual  as  a  means  of  target  ac¬ 
quisition  versus  visual  search  aided  by  electro-optical/TV  sensors.  It  is 
apparent  from  this  experiment  that  when  the  use  of  the  visual  aids  was 
optional.  Observers  preferred  the  DV  method.  When  the  Observer  used  the 
assigned  search  method,  DV  +  VF  and  DV  +  WF  methods  provided  acquisition  at 
greater  ranges  than  DV  or  DV  +  NF  methods  (Table  2-IX) .  This  indicates  that 
a  combination  of  some  magnification  and  a  reasonably  large  FOV  possibly  aided 
the  acquisition  process. 

The  secondary  objective  of  sub-experiment  1  was  to  demonstrate 
the  utility  of  terrain  tables  as  a  tool  for  the  evaluation  of  alternative 
target  acquisition  systems  and  techniques.  In  as  much  as  varied  results 
were  obtained  regarding  the  degree  of  significance  of  a  wide  number  of 
variables,  the  utility  of  terrain  tables  for  such  purposes  had  been  demon¬ 
strated.  However,  the  relative  utility  to  studies  made  in  the  real  world 
cannot  be  determined  until  comparable  studies  are  conducted  under  actual 
field  conditions  and  comparative  analyses  are  made. 

2.6.2  Hypothesis  Correlation 

1.  Clutter  -  Clutter  significantly  influenced  target  acqui¬ 
sition  in  approximately  two-thirds  of  the  runs,  with  in¬ 
creasing  levels  of  clutter  decreasing  acquisition  range, 
although  table  configuration  reversed  the  trend  and  in 
terrain  table  configuration  E  the  degree  of  clutter  had 
little  effect  upon  acquisition  capability.  Therefore, 
the  hypothesis  as  stated  is  generally  supported. 

_2  Contrast  -  The  degrees  of  contrast  used  in  sub-experiment 
1  appear  significant  with  an  inverse  exception  of  terrain 
table  configuration  D,  in  which  case  low  contrast  resulted 
in  a  significantly  greater  number  of  acquisitions.  Gen¬ 
erally,  greater  ranges  wpre  noted  for  high  contrast,  but 
more  acquisitions  were  made  with  low  contrast.  The 
hypothesis  is  not  supported. 

_3  Clutter /Contrast  Interaction  -  According  to  the  two-way 

ANOVA  for  clutter  versus  contrast,  the  GLM  did  not  show  a 
significant  F  ratio.  The  hypothesis  is  not  supported  in 
regard  to  interaction  between  clutter  and  contrast,  although 
the  hypothesis  statements  regarding  clutter  are  generally 
supported. 
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4_  Illumination  Angle  -  Illumination  angle  was  a  secondary 
objective  of  sub-experiment  1  and  when  treated  alone  as 
a  main  effect  resulted  in  an  F  ratio  which  was  not  signi¬ 
ficant  by  the  GLM;  however,  the  chi-square  test  produced 
a  significant  result  in  terms  of  acquisitions  achieved. 
However,  the  no-shadow  condition  and  the  most  visible 
shadow  (90  degree  sun  angle)  were  the  higher  scoring 
conditions.  Also,  no  apparent  interaction  was  noted 
between  illumination  angle  and  search  method.  The 
hypothesis  that  the  effects  of  shadow  would  increase  the 
effects  of  clutter  was  not  supported  by  the  GLM  data  as 
shown  in  Table  2-IV. 

_5  Overcast  Illumination  -  This  hypothesis  is  supported. 

_6  Sun  Angle  -  A  chi-square  test  showed  significant  difference 
in  the  number  of  acquisitions  between  overcast,  or  sun 
angles  of  180,  135,  or  90  degrees.  More  acquisitions 
were  made  at  90  degrees  and  in  overcast  than  at  135  or 
180  (0  azimuth  was  not  available) .  However  there  was  no 
significant  difference  in  range  at  acquisition.  The  hy¬ 
pothesis,  as  stated,  is  therefore  not  supported. 

2.6.3  Additional  Results  and  Conclusions 

_1  Terrain  Table  Configurations  -  The  chi-square  test  indi¬ 
cated  that  terrain  table  configurations  produced  a  signi¬ 
ficant  effect  on  acquisition  of  targets.  An  in-depth  study 
of  this  effect  was  not  included  in  the  scope  of  work. 

2_  Observer  Differences  -  Although  the  mean  range  of  acquisi¬ 
tion  was  nearly  the  same  for  both  trained  and  untrained 
Observers,  the  trained  Observers  acquired  a  greater  number 
of  targets  to  a  significant  degree.  The  chi-square  test 
developed  a  definite  superiority  in  the  ability  of  trained 
observers  to  identify  more  targets.  Inter-subject  variabil¬ 
ity  within  groups  was  not  addressed  and  could  have  influ¬ 
enced  this  result.  Section  2.5.4  delineates  some  inter¬ 
action  between  terrain  table  configurations  and  Observer 
training.  However,  no  particular  conclusions  can  be 
statistically  identified  with  the  available  data. 

3  Briefing  Level  -  Due  to  the  insufficient  quantity  of  use¬ 
ful  data  obtained  when  Observers  were  briefed  to  search  the 
entire  target  zone,  a  request  was  submitted  and  approved  to 
change  this  to  a  1-square  kilometer  search  area,  effecting 
a  considerable  increase  in  statistically  useful  information. 
Even  though  this  tended  to  slightly  degrade  the  validity  of 
some  comparisons,  it  is  believed  that  the  data  obtained  is 
sufficiently  accurate  to  justify  the  conclusions  stated 


36 


herein.  The  change  in  briefing  level  was  made  at  the  end 
of  the  runs  on  terrain  table  configuration  C.  For  configura¬ 
tions  D  and  E  there  was  a  significant  increase  in  number  of 
targets  detected.  However,  for  configuration  F  the  number 
was  approximately  the  same  as  before  which  was  primarily 
due  to  lesser  performance  by  the  untrained  Observers.  The 
change  in  briefing  level  did  tend  to  help  target  acquisi¬ 
tion. 

3 . 0  SUB-EXPERIMENT  2 

3.1  Objectives 

As  stated  in  the  IB1  Project  Plan  the  primary  objectives  of 
sub-experiment  2  were  to  determine  target  acquisition  performance  as  a 
function  of: 


1^  Method  of  search 

2_  Number  of  targets  per  zone. 

The  secondary  objectives  were  determination  of  acquisition 
performance  as  a  function  of: 

1.  Target  area  clutter 

2_  Target-to-background  contrast. 

3.2  Experimental  Design 

The  experiment  examined  in  detail  the  performance  of  four  search 
methods  under  six  different  conditions  of  varying  clutter/contrast  combina¬ 
tions  and  using  four  different  target  array  conditions.  These  four  search 
methods  were: 

1_  Direct  visual  search  without  sensor  aids 

2_  Direct  visual  search  in  parallel  with  search  using  a  tele¬ 
vision  sensor  on  a  narrow  (2  degrees)  FOV  (NF) 

Direct  visual  search  in  parallel  with  search  using  a  tele¬ 
vision  sensor  on  a  wide  (8  degrees)  FOV  (WF) 

h_  Direct  visual  search  in  parallel  with  search  using  a  tele¬ 
vision  sensor  using  a  variable  FOV  (zoom  lens, 8  to  2  degrees)  (VF) . 

Two  Observers,  one  trained  and  one  untrained,  ran  identical  run 
sets,  giving  a  total  of  192  experimental  runs. 

The  experimental  design  is  shown  in  Figure  3-1. 
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(1  table  configuration)  x  (4  search  modes)  x  (6 
clutter/contrast  conditions)  x  (4  target  array 
conditions)  x  (2  Observers  running  identical 
runs)  =  192  experimental  runs. 


3.3  Hypotheses 


Prior  to  the  experiments,  the  following  hypotheses  relative  to 
sub-experiment  2  were  postulated  (reference  Project  Plan  IB1  of  October  1974 
Annex  K,  Section  5) . 


FACTORS  CONSIDERED 
METHOD  OF  SEARCH 


4  TYPES 


UNVARIED 


CLUTTER  -  3  LEVELS 
CONTRAST  -  2  LEVELS 
NUMBER  OF  ELEMENTS  IN  TARGET  ARRAY 


OBSERVERS  REQUIRED 

8  FOR  EACH  OF  4  SETS  OF  RUNS 

MEASURES  OF  EFFECTIVENESS 
RANGE  AT  ACQUISITION 
PERCENT  OF  TARGETS  ACQUIRED 
NUFBER  OF  FALSE  ACQUISITIONS 


NUW3ER  OF  TARGETS 

VARIABLE  0.  1 .  3,  9 


4  LEVELS 


NUMBER  OF  EXPERIMENTAL  RUNS 

(96  CELLS)  x  (1  TABLE  CONFIGURATION)  x 
(2  OBSERVERS  RUNNING  IDENTICAL  RUNS)  - 
192  EXPERIMENTAL  RUNS 


Figure  3-1.  Design  of  Sub-experiment  2 


1^  Clutter  will  affect  target  acquisition  in  the  order  of 
best  acquisition  to  worst  as  low,  medium,  and  high 

2_  High  contrast  will  produce  better  target  acquisition  than 
low  contrast 

_3  Clutter  will  interact  with  contrast  such  that  medium  and 
high  clutter  conditions  will  differentially  degrade  target 
acquisition;  at  equivalent  levels  of  contrast  target 
acquisition  will  be  lower  with  clutter. 

Not  stated,  but  implicit  in  the  design  of  this  sub-experiment, 
is  the  hypothesis  that  number  of  targets  will  influence  acquisition  per¬ 
formance  such  that  higher  target  numbers  will  produce  better  performance. 

3.4  Method  of  Accomplishment 

3.4.1  General  Description 

Each  of  the  four  search  methods  was  used  by  different  Observers 
against  targets  positioned  on  the  terrain  table. 

The  habitat  was  brought  to  the  simulated  altitude  (3000 
feet)  and  fixed  in  position.  The  run  was  started  by  the  Experimenter 
at  which  time  the  curtain  was  raised  and  the  terrain,  starting  at  a  slant 
range  of  13  km,  moved  under  the  cockpit  to  simulate  a  flight  velocity  of 
approximately  400  knots.  Each  Observer  made  six  separate  runs.  Each  run 
posed  a  different  situation  of  clutter/contrast  and  number  of  elements  in 
target  array,  while  the  illumination  was  maintained  constant  (overcast  con¬ 
dition).  The  Experimenter  monitored  the  Observer's  search  on  the  TV  monitor 
at  his  station.  Eight  Observers  -  two  for  each  search  method  -  completed 
run  sets  over  the  terrain  table,  with  the  different  numbers  of  targets  in 
the  different  zones.  Next,  the  number  of  targets  in  each  zone  was  changed 
to  another  level,  and  a  second  set  of  eight  Observers  made  runs  over  the 
terrain  table.  This  pattern  was  repeated  until  four  sets  of  runs  were 
completed:  four  target  zones  had  each  level  of  the  variable  number  of 

targets  and  two  target  zones  had  two  repeated  values.  Each  run  ended  when 
the  Observer  signaled  acquisition. 

The  instant  that  the  Observer  signaled  acquisition,  a  curtain 
came  down  in  front  of  him  and  the  sensor;  the  range  and  time  of  the  acquisi¬ 
tion  were  recorded.  The  terrain  and  habitat  were  repositioned  for  the  next 
run.  The  run  was  stopped  by  the  Experimenter  when  the  Observer  had  over¬ 
flown  his  target. 

At  the  end  of  each  of  the  six  runs,  the  Experimenter  asked 
the  Observer  questions  about  the  target  (location,  number,  color,  and 
direction)  to  verify  correct  acquisition.  This  information  was  recorded 
on  the  Experimenter  Check  Sheet  and  also  entered  into  the  computer  through 
the  use  of  the  keyboard.  Then  the  next  run  began. 
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3.4.2 


Observers 


Observer  selection  for  Experiment  2  consisted  of: 

16  Martin  Marietta 
5  Air  Force 

10  Navy 
1  Marine 

32 

The  runs  were  made  from  29  January  to  2  February  1975. 

3.4.3  Terrain  Table  Layout 

The  sub-experiment  utilized  one  of  the  six  terrain  tabli  con¬ 
figurations  that  were  used  in  sub-experiment  1  (Configuration  F) .  Therefore, 
all  six  combinations  of  clutter  and  contrast  were  used,  one  for  each  of  the 
six  target  zones  as  shown  in  Table  3-1,  but  the  effects  of  these  variables 
were  not  separable  from  the  effects  of  other  characteristics  of  the  indivi¬ 
dual  target  zones.  Only  one  type  of  illumination  was  used  in  the  sub¬ 
experiment:  overcast.  The  numbers  of  target  elements  located  in  the  target 
zones  were  none,  one,  three,  and  nine;  the  numbers  of  targets  were  rotated 
through  the  six  zones  as  shown  in  Table  3-II. 


TABLE  3-1.  COMPOSITION  OF  CONFIGURATION  F 


Target  Zone 

I 

II 

hi 

IV 

V 

VI 

Clutter/ contrast 

ML 

HL 

t 

MH 

HH 

LL 

Clutter  was  classified  as  either  low,  medium,  or  high.  The 
levels  of  clutter  were  defined  in  terms  of  the  number  of  target-like  objects 
in  the  immediate  vicinity  of  the  target  —  low  clutter  was  represented  by 
no  trees  in  a  200  meter  radius  circle  about  the  target;  medium  by  20  trees; 
and  high  by  60  trees. 

The  contrast  of  the  individual  targets  with  respect  to  their 
backgrounds  took  two  levels:  a  low-contrast  case  in  which  the  targets  were 
only  slightly  darker  than  the  background;  and  a  high-contrast  case,  in  which 
targets  were  considerably  darker  than  the  background. 

Two  different  colors  were  used  for  the  tank  targets:  dark 
O.D.  (high  contrast)  and  beige  (low  contrast).  Contrast  was  defined  as 
the  difference  between  the  luminance  of  the  target  and  background  divided 
by  the  luminance  of  the  background,  i.e.,  C  =  (Lf  -  Lg)/Lg-  Table  3-II  shows 
the  average  contrast  of  the  tanks  in  each  target  zone  with  respect  to  the 
background  for  the  four  table  sub-configurations  used. 
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TABLE  3-II.  NEGATIVE  CONTRAST  RATIO  OF  THE  TARGETS 
AND  NUMBER  OF  TANKS  IN  EACH  ZONE 


Configuration 

Fl 

Configuration 

F2 

Configuration 

f3 

Configuration 

?4 

Number 

Con- 

Number 

Con-  ! 

Number 

Con-  1 

Number 

Con- 

Target 

of 

trast 

of 

trast 

of 

trast 

of 

trast 

Zone 

Tanks 

Ratio 

Tanks 

Ratio 

Tanks 

Ratio 

Tanks 

Ratio 

I 

0 

- 

9 

0.35 

3 

0.40 

1 

0.36 

II 

1 

0.33 

3 

0.34 

1 

0.36 

3 

0.40 

III 

3 

0.73 

1 

0.78 

3 

0.81 

1 

0.73 

IV 

1 

0.79 

0 

- 

9 

0.78 

3 

0.73 

V 

3 

0.79 

1 

0.79 

0 

- 

9 

0.79 

VI 

9 

0.27 

3 

0.28 

1 

0.67 

0 

- 

3.4.4  Illumination  Conditions 

Overhead  fluorescent  lighting  simulating  an  overcast  condition 
was  used  for  all  runs  in  sub-experiment  2. 


«  3.4.5  Measures  Used 

For  each  individual  run,  the  range  and  time  of  acquisition 
were  recorded;  valid  as  well  as  false  acquisitions  and  failures  to  acquire 
targets  were  also  recorded. 


3.5  Results 

Two  working  procedures  were  used  in  the  analysis  of  the  data 
for  sub-experiment  2: 

1.  Any  correct  acquisition  made  at  the  proper  location  was 
considered  valid,  regardless  of  how  many  tanks  were 
reported  at  that  location  except  when  the  target  zone 
contained  no  tanks.  Thus  when  an  observer  reported  any 
number  of  tanks  at  a  proper  location  actually  containing 
1,  3,  or  9  tanks  this  was  recorded  as  a  valid  target 
acquisition.  In  the  zero  tanks  case,  only  a  negative 
report  was  considered  valid.  Ultimately,  the  zero  tank 
case  had  to  be  discarded  due  to  limitations  in  the  ex¬ 
perimental  procedures  which  precluded  any  meaningful 
treatment  of  those  data  (see  discussion  in  3. 5. 2. 2). 

In  the  analyses  that  follow  only  valid  acquisitions  are 
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considered  in  the  statistical  computations.  Target 
number  is  considered  in  a  separate  analysis  of  that 
variable. 


1_  All  data  reporting  mean  range  and  the  standard  deviations 
thereof  are  based  upon  the  number  of  acquisitions  made, 
and  do  not  include  unsuccessful  acquisition  attempts. 

The  two  primary  objectives  of  sub-experiment  2  were  the  effects 
of  method  of  search  and  effects  of  the  number  of  targets  per  zone.  Secondary 
objectives  were  effects  of  clutter  and  contrast;  an  additional  variable 
was  Observer  training.  In  this  sub-experiment  a  total  of  32  Observers  made 
83  acquisitions.  However,  21  of  these  were  in  the  zero  target  condition, 
for  which  the  range  value  was  indeterminate.  The  following  paragraphs 
describe  the  analysis  performed  in  sub-experiment  2  data. 

3.5.1  Analysis  of  Variance 

Table  3-III  presents  the  results  of  the  overall  ANOVA  using 
the  GLM  conducted  for  this  experiment.  In  this  analysis  the  zero  target 
condition  is  excluded  because  in  most  zero  target  cases  the  experiment  ran 
to  the  minimum  range  (i.e.,  the  Observer  was  over  or  beyond  the  target  when 
the  run  was  terminated  by  the  Experimenter) ,  Only  clutter  was  found  to  be 
significant,  as  discussed  in  Section  3.5.3.  Targets  per  zone  became  a  sig¬ 
nificant  factor  when  the  zero  case  was  introduced. 


TABLE  3-III.  ANOVA  SUB-EXPERIMENT  2  (GLM)  (WITHOUT  ZERO  TARGET  CONDITION) 


Source 

Sum  of  Squares 

Degrees  of 
Freedom 

Mean  Square 

F  Ratio 

Assigned  Search 
Method 

7512490.01 

3 

2504163.33 

0.82 

Clutter 

27339069.83 

2 

13609534.91 

4.45* 

Contrast 

1405911.37 

1 

1405911.37 

0.46 

No.  Targets 

7104905.52 

2 

3552452.76 

1.16 

Observe rs 

8088418.01 

1 

8088418.01 

2.63 

Error 

159747836.07 

52 

3072073.00 

*Significant  at  the  .05  level 
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3.5.2  Primary  Objectives 

3. 5. 2.1  Search  Method 

3. 5. 2. 1.1  Assigned  Search  Method 

There  were  no  significant  F  ratio  differences  in  target 
acquisition,  either  in  range  or  in  number  of  correct  acquisitions,  when 
grouped  by  assigned  search  method.  Table  3- IV  shows  those  results,  which 
includes  the  correctly  reported  zero-target  locations.  Table  3-V  presents 
the  same  data  but  the  zero  target  cases  have  been  excluded. 


TABLE  3- IV.  TARGET  ACQUISITION  BY  ASSIGNED  SEARCH  METHOD 
(INCLUDING  ZERO  TARGET  CONDITION) 


Assigned 

Search  Method 

Mean 

Range 

(x) 

Standard 

Deviation 

Co) 

Number  of 
Acquisitions 

DV 

3655m 

2524 

24 

DV  +  NF 

3535m 

1970 

24 

DV  +  WF 

3882m 

1892 

22 

DV  +  VF 

4094m 

2271 

13 

Chi-square  (xz  =  7.02,  DF  =  3)  Not  Significant 


TABLE  3-V.  TARGET  ACQUISITION  BY  ASSIGNED  SEARCH  METHOD 
(LESS  ZERO  TARGET  CONDITION) 


Assigned 
Search  Method 


DV 

DV  +  NF 
DV  +  WF 
DV  +  VF 


Mean 

Range 

(X) 


4566m 

4817m 


Standard 

Deviation 

(0) 

Number  of 
Acquisitions 

2437 

17 

1769 

18 

1569 

17 

2085 

10 

Chi-square  (v^  =  4.32,  DF  =  3)  Not  Significant 


3. 5. 2. 1.2 


Actual  Search  Method 


When  questioned  as  to  search  method  actually  used,  there  was 
a  stated  preference  for  the  direct  visual  mode.  Several  Observers  who 
were  assigned  the  DV  +  NF  and  DV  +  t7F  ir^des  did  not  use  the  aid  at  all. 
These  data  are  shown  in  Tables  3-VI  and  3-VII.  The  difference  in  acquisi 
tion  range  is  not  significant  for  the  actual  search  mode.  In  fact,  the 
actual  search  method  is  not  markedly  different  from  the  assigned  search 
method  in  acquisition  range. 


TABLE  3-VI.  TARGET  ACQUISITION  BY  ACTUAL  SEARCH  METHOD 
(WITH  ZERO  TARGET  CONDITION) 


Search 

Method 

Mean 

Range 

(x) 

Standard 

Deviation 

(a) 

Sample 

Size 

(N) 

Misses 

DV 

3703m 

2172 

38 

47 

DV  +  WF 

3680m 

1863 

17 

17 

DV  +  NF 

3595m 

2350 

16 

13 

DV  +  VF 

4201m 

2338 

12 

32 

Chi-square 

(X2  =  6.96 

,  DF  =  3)  Not  significant 

TABLE  3-VII.  TARGET  ACQUISITIONS  BY  ACTUAL  SEARCH 
(WITHOUT  ZERO  TARGET  CONDITION) 

METHOD 

Search 

Method 

Mean 

Range 

(x) 

Standard 

Deviation 

(o) 

■i 

Misses 

DV 

4391m 

2033 

29 

43 

DV  +  WF 

4366m 

1554 

13 

15 

DV  +  NF 

4606m 

2158 

11 

12 

DV  +  VF 

5039m 

2081 

9 

28 

2 

Chi-square  (x  =  4.81,  DF  =  3)  Not  significant 


3. 5. 2. 2 


Number  of  Targets 


The  data  in  Table  3-III  indicate  no  significance  for  the 
number  of  targets  in  the  zone,  whereas  the  chi-square  test  result  is  signi¬ 
ficant  in  Table  3-VIII.  Table  3-VIII  shows  definite  improvement  in  range 
at  acquisition  as  the  number  of  targets  per  zone  is  increased  from  1  to  3 
to  9.  However,  the  relatively  high  number  of  correct  zero  target  condition 
acquisitions  (when  compared  with  the  overall  rate  of  acquisition  for  this 
experiment  and  for  sub-experiment  1)  was  not  expected.  For  this  reason, 
the  correct  zero  acquisition  situation  was  explored  in  some  depth.  The 
range  values  quoted  for  these  acquisitions  could  have  no  statistical  signi¬ 
ficance  whatever  since  they  merely  represented  the  point  at  which  the 
Experimenter  had  terminated  the  run,  with  the  area  penetrated  as  far  as 
possible. 


TABLE  3-VIII.  TARGET  ACQUISITIONS  FOR 
TARGETS  PER  ZONE 


Targets/ 

Zone 

Mean 

Range 

00 

Standard 

Deviation 

(a) 

Sample 

Size 

(N) 

0 

1840m 

467 

21 

1 

3626m 

1692 

16 

3 

4819m 

2179 

30 

9 

4846m 

1443 

16 

Chi-square  (x^  =  16.15,  DF  =  3)  Significant 


Since  the  experimental  procedures  did  not  provide  for  briefing 
the  Observer  to  expect  a  zero  target  case  they  were  not  briefed  to  terminate 
a  run  with  any  form  of  a  negative  report.  Rather,  their  target  zone 
briefing  "...tanks  have  been  reported  in  the  area..."  would  tend  to 
motivate  them  to  continue  their  search  as  long  as  possible.  Thus,  the 
zero  target  case  could  have  no  commonality  of  meaning,  either  in  range  or 
number  of  valid  acquisitions,  with  the  1,  3,  and  9  target  cases. 

3.5.3  Secondary  Objectives 

3. 5. 3.1  Clutter 

The  ANOVA  in  Table  3-III  showed  clutter  to  be  significant. 

Table  3-IX  shows  the  results  for  clutter  without  the  zero-target  condition 
and  Table  3-X,  with  the  zero-target  condition.  As  the  level  of  clutter 
increased  the  detection  range  and  the  number  of  detections  decreased,  al¬ 
though  the  number  of  detections  at  the  medium  and  high  levels  are  not 
significantly  different  from  each  other. 
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TABLE  3- IX.  EFFECT  OF  CLUTTER  (WITHOUT 
ZERO  TARGET  CONDITION) 


Level 

Mean 

Range 

(x) 

Standard 

Deviation 

(5) 

Low 

5197m 

1900 

28 

Medium 

4658m 

1769 

18 

High 

3173m 

1557 

16 

2 

Chi-square  (x  =  5.46,  DF  =  2)  Not  significant 


TABLE  3-X.  EFFECT  OF  CLUTTER  (WITH 
ZERO  TARGET  CONDITION) 


Level 

Mean 

Range 

<5c) 

Standard 

Deviation 

(o) 

m 

Low 

4526m 

2172 

35 

Medium 

3726m 

2135 

25 

High 

2593m 

1572 

23 

2 

Chi-square  (x  =  5.26,  DF  =  2)  Not  significant 


3. 5. 3. 2  Contrast 

Tables  3-XI  and  3-XII  show  the  results  for  contrast.  Although 
the  ANOVA  did  not  show  a  significant  difference,  there  is  a  tendency  to 
find  more  targets  at  the  low  level  of  contrast.  High  contrast  enabled 
acquisition  at  somewhat  longer  ranges.  Table  3-XII  is  included  only  to 
show  the  effects  of  incorporating  the  zero  target  case  on  the  data. 
Obviously,  contrast  has  no  meaning  when  there  are  no  targets  present. 
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TABLE  3-XI.  EFFECTS  OF  CONTRAST  (WITHOUT 
ZERO  TARGET  CONDITION) 


Mean 

Standard 

Sample 

Range 

Deviation 

Size 

Level 

(JO 

(5) 

(N) 

Low 

4117m 

1745 

40 

High 

5247m 

2096 

22 

2 

Chi-square  (x  =  7.16,  DF  =  1)  Significant 


TABLE  3-XII.  EFFECTS  OF  CONTRAST  (WITH 
ZERO  TARGET  CONDITION) 


Mean 

Standard 

Sample 

Range 

Deviation 

Size 

Level 

(5c) 

(5) 

(N) 

Low 

3585m 

1855 

51 

High 

4011m 

2543 

32 

Chi-square  (x^  =  6.88,  DF  =  1)  Significant 


The  effects  of  clutter/contrast  are  very  much  the  same  as 
those  found  in  sub-experiment  1 .  Table  3-XIII  reports  these  results  with 
the  zero  target  condition  omitted  from  the  data,  i.e.,  62  acquisitions 
only.  The  difference  between  the  values  are  significant,  however,  using 
the  chi-square  test. 


TABLE  3-XIII.  EFFECT  OF  CLUTTER/ CONTRAST 

(EXCLUDING  ZERO  TARGET  CONDITIONS) 


Clutter/ 

Contrast 

Mean 

Range 

<x) 

Standard 

Deviation 

Co) 

Number 

Acquisitions 

LL 

4643m 

1414 

14 

ML 

5021m 

1847 

11 

HL 

2963m 

1355 

15 

LH 

5750m 

2199 

14 

MH 

4086m 

1597 

7 

HH 

6332m* 

1 

*Only  one  acquisition 

Chi-square  (x^  =  27.00,  DF  *  5)  Significant 


The  number  of  targets  positioned  in  a  specific  area  tends  to  interact 
with  the  clutter  in  that  area.  In  Table  3-XIV,  the  effect  of  clutter 
on  target  number  is  indicated.  An  apparent  anomaly  in  these  results  is 
the  zero  target  case  (see  the  discussion  of  number  of  targets  under 
3. 5. 2. 2). 


TABLE  3-XIV.  TARGET  ACQUISITIONS  IN  CLUTTER  CONDITIONS  BY  NUMBER  OF  TARGETS  IN  AREA 


Clutter 

Condition 

Targets  in  Area 

0  . 

i 

3 

9 

Acquisitions 

Trials 

Percent 

Acquisitions 

Trials 

Percent 

Acquisitions 

Trials 

Percent 

Acquisitions 

Trials 

Percent 

Low 

7 

6 

88 

6 

24 

25 

17 

24 

71 

5 

8 

63 

Medium 

7 

16 

44 

3 

16 

19 

5 

16 

31 

10 

16 

63 

High 

7 

8 

88 

7 

24 

29 

8 

24 

33 

_ 

1 

8 

12 

3.5.4  Additional  Results 

3. 5. 4.1  Observer  Differences 

Trained  Observers  made  45  correct  acquisitions,  untrained 
made  38.  (Note  that  reporting  one  or  more  targets  in  a  zone  is  a  valid 
acquisition  except  for  the  zero-target  case  where  "no  target"  is  correct). 
Omitting  the  zero-target  case,  trained  Observers  made  34  acquisitions 
with  a  mean  range  of  acquisition  of  4890  meters  and  a  standard  deviation 
of  2030.  For  untrained  Observers  the  range  was  4066  with  a  standard 
deviation  of  1750  with  28  acquisitions.  The  differences  are  not  statis¬ 
tically  significant,  although  trained  Observers  performed  somewhat  better. 
Knowledge  of  inter-subject  variability  was  not  obtained. 

3.6  Conclusions 

3.6.1  Primary  Objectives 

1  Method  of  search  -  The  primary  objective  of  sub-experiment 
2  of  the  IB1  program  was  to  determine  whether  direct 
visual  search  was  a  more  effective  means  of  target  acqui¬ 
sition  than  visual  search  aided  by  electro-optical/ 
stabilized  sensors.  However,  to  comply  with  the  primary 
objectives  of  Experiment  IB1  and  this  sub-experiment, 
both  assigned  search  method  and  actual  search  method  used 
were  examined.  When  the  test  results  were  analyzed,  in¬ 
cluding  the  zero-target  areas  (Table  3-IV) ,  and  then 
excluding  the  zero-target  areas  (Table  3-V) ,  the  longest 
range  at  acquisition  was  obtained  with  the  DV  +  VF  method. 
This  was  true  for  both  the  assigned  search  method  and  the 
actual  search  method.  However,  under  the  assigned  search 
method,  the  DV  +  VF  method  produced  the  least  number  of 
acquisitions  of  all  four  search  methods  (Tables  3-IV  and 
3-V) ,  whereas  the  actual  search  method  data  showed  the 


least  acquisitions  by  the  DV  +  NF  method  (Tables  3-VI  and 
3-VII) .  The  results  of  sub-experiment  2  must  be  con¬ 
sidered  inconclusive  as  pertains  to  the  primary  objective 
of  method  of  search. 

2_  Number  of  Targets  per  Zone  -  This  factor  was  a  primary 
objective  of  sub-experiment  2,  and  therefore  was  explored 
in  some  depth  even  though  the  ANOVA  in  Table  3-III  showed 
no  significant  F-ratio  for  the  number  of  targets  per  zone. 
Table  3-VIII  shows  that  the  range  at  target  acquisition 
was  significantly  better  for  the  greater  number  of  targets 
(3  to  9)  located  in  a  zone.  However,  there  were  more 
acquisitions  with  three  targets  per  zone  than  with  one  or 
nine  per  zone.  The  test  design  calling  for  the  number  of 
attempts  in  this  sub -experiment  to  h  much  smaller  than 
the  other  sub-experiments  could  be  a  contributing  factor 
to  the  inconclusiveness  of  these  results. 

Secondary  Objectives 

1  Clutter/Contrast  -  Clutter  was  investigated  both  with  and 
without  zero-target  conditions,  and  according  to  the  ANOVA 
shown  in  Table  3-III,  it  was  the  only  factor  determined  to 
be  significant  for  this  sub-experiment.  Both  parameters  of 
range  at  acquisition  and  number  of  acquisitions  were  in¬ 
fluenced  by  the  amount  of  clutter  used  in  these  runs.  As 
the  clutter  increased,  the  range  was  decreased  and  the 
number  of  acquisitions  was  reduced.  The  interaction  of 
clutter  and  contrast  produced  results  similar  to  those  in 
sub-experiment  1,  in  that  under  both  low  and  high  contrast 
conditions  performance  is  reduced  as  clutter  increases. 

It  would  appear  that  clutter  produced  a  definitely  stronger 
influence  than  contrast  under  the  conditions  established 
for  sub-experiment  2. 

Hypotheses  Correlations 

_1  Clutter  -  This  hypothesis  has  been  supported  by  the  dis¬ 
cussion  under  Secondary  Objectives,  Paragraph  3. 6. 2,1. 

2.  Contrast  -  This  hypothesis  has  not  been  supported  to  any 
measurable  degree  since  the  high  contrast  produced  acquisi¬ 
tion  at  greater  ranges  but  in  lesser  numbers  of  acquisition 
than  the  conditions  of  low  contrast. 

J3  Clutter/Contrast  Interaction  -  The  first  portion  of  this 
hypothesis  is  supported  in  regard  to  range  at  acquisition 
but  not  supported  in  number  of  acquisitions,  as  shown  in 
Table  3-XIII.  However,  the  second  part  of  the  hypothesis 
is  not  supported  when  all  three  levels  of  clutter  are 
examined  in  Table  3-XIV  pertaining  to  interaction  of 
clutter  and  contrast. 


3.6.4 


Additional  Conclusions 


A  comparison  of  the  performances  made  by  trained  Observers 
versus  those  of  untrained  Observers  was  accomplished  even  though  no 
significance  was  shown  by  the  ANOVA  in  Table  3-I1I.  The  overall  data  for 
this  sub-experiment  shows  that  trained  Observers  made  a  greater  number  of 
valid  acquisitions.  When  the  zero-target  conditions  were  omitted  from  the 
computations,  the  results  showed  that  the  range  at  acquisition  was  con¬ 
siderably  greater  for  the  trained  Observers,  but  the  number  of  acquisitions 
was  only  moderately  improved  over  the  untrained  Observers.  The  performance 
of  trained  Observers  exceeded  that  of  untrained  Observers  in  sub-experiment 
2.  The  degree  of  homogeneity  within  either  particular  group  is  not  known. 
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4.0 


SUB-EXPERIMENT  3 


4.1  Objectives 

As  stated  in  the  IB1  Project  Plan  the  primary  objectives  of 

sub-experiment  3  were  to  determine  target  acquisition  performance  as  a 
function  of: 

_1  Method  of  search 

2^  Illumination  angles  other  than  those  used  in  sub-experiment  1. 

Secondary  objectives  were  to  measure  acquisition  performance  as 
a  function  of : 

_1  Target  area  clutter 

1_  Target-to-background  contrast. 

4.2  Experimental  Design 

The  experiment  examined  in  detail  the  performance  of  four 

search  methods  under  six  different  conditions  of  varying  clutter/contrast 
combinations  and  using  six  different  illumination  conditions,  as  shown  in 
Figure  4-1.  The  four  search  methods  were: 

1^  Direct  visual  search  without  sensor  aids 

2_  Direct  visual  search  in  parallel  with  search  using  a 
television  sensor  with  a  narrow  (2  degrees)  FOV  (NF) 

3  Direct  visual  search  in  parallel  with  search  using  a 
television  sensor  with  a  wide  (8  degrees)  FOV  (WF) 

4_  Direct  visual  search  in  parallel  with  search  using  a 

television  sensor  using  a  variable  FOV  (zoom  lens,  8  to 
2  degrees) (VF) . 

Two  Observers,  one  trained  and  one  untrained,  ran  identical 
run  sets,  giving  a  total  of  288  experimental  runs.  No  knowledge  was  ob¬ 
tained  as  to  whether  either  group  was  more  homogeneous  than  the  other. 

(1  table  configuration)  x  (4  search  modes)  x 
(6  clutter/contrast  conditions)  x  (6  illumination 
conditions)  x  (2  Observers  running  identical  runs)  = 

288  experimental  runs. 

4.3  Hypothesis 

Prior  to  the  experiments,  the  following  hypothesis  relative  to 
sub-experiment  3  were  postulated  (reference  Project  Plan  IB1  of  October 
1974,  Annex  K,  Section  5). 
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Mq,  < b  /<5b 
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*\  *v^ 

^\  o- 


DV  -  DIRECT  VISUAL 
NFOV  -  NARROW  FIELD  OF  VIEW 
WFOV  -  WIDE  FIELD  OF  VIEW 


FACTORS  CONSIDERED 

METHOD  OF  SEARCH  -  4  TYPES 
CLUTTER  -  3  LEVELS 
CONTRAST  -  2  LEVELS 
ILLUMINATION  -  6  LEVELS 

OBSERVERS  REQUIRED 

8  FOR  EACH  OF  6  SUN  ANGLES 

MEASURES  OF  EFFECTIVENESS 
RANGE  AT  ACQUISITION 
PERCENT  OF  TARGETS  ACQUIRED 
NUMBER  OF  FALSE  ACQUISITIONS 

NUMBER  OF  TARGETS 
3  PER  AREA 

NUMBER  OF  EXPERIMENTAL  RUNS 

(144  CELLS)  x  (1  TABLE  CONFIGURATION)  x 
(2  OBSERVERS  RUNNING  IDENTICAL  RUN-SETS) 

=  288  EXPERIMENTAL  RUNS 

Figure  4-1.  Design  of  Sub-experiment  3 


_1  Clutter  will  affect  target  acquisition  in  the  order  of 
best  acquisition  to  worst  as  low,  medium,  and  high 


2_  High  contrast  will  product  better  target  acquisition 
than  low  contrast 

2  Clutter  will  interact  with  contrast  such  that  medium  and 
high  clutter  conditions  will  differentially  degrade  target 
acquisition;  at  equivalent  levels  of  contrast  target 
acquisition  will  be  lower  with  clutter 

4^  Effects  of  shadow  will  act  to  increase  the  effects  of 

clutter;  at  low  clutter  condition  shadow  will  aid  target 
acquisition;  at  high  clutter  conditions  shadow  will  re¬ 
duce  target  acquisition  performance 

_5  Sun  angle  will  improve  target  acquisition  when  it  causes 
shadow  to  increase  the  lateral  size  of  the  target;  target 
acquisition  performance  will  be  better  at  90  degrees  sun 
angle  than  at  0  or  180  degrees;  45  and  135  degrees  sun 
angles  will  be  better  than  0  or  180  degrees  but  less  than 
90  degrees. 

4.4  Method  of  Accomplishment 

4.4.1  General  Description 

Each  of  the  four  search  methods  was  used  by  different  Observers 
against  targets  positioned  on  the  terrain  table. 

The  habitat  was  brought  to  the  simulated  altitude  (3000  ft) 
and  fixed  in  position.  The  run  was  started  by  the  Experimenter  at  which 
time  the  curtain  was  raised  and  the  terrain,  starting  at  a  slant  range  of 
13  km,  moved  under  the  cockpit  to  simulate  a  flight  velocity  of  approxi¬ 
mately  400  knots.  Each  Observer  made  six  separate  runs.  Each  run  posed  a 
different  situation  of  clutter/contrast  and  illumination.  The  Experimenter 
monitored  the  Observer's  search  on  the  TV  monitor  at  his  station. 

In  sub-experiment  3  there  were  288  runs  (48  each  at  El  20  de¬ 
grees,  Az  180  degrees;  El  20,  Az  135;  El  20,  Az  90;  El  20,  Az  45;  El  40, 

Az  45;  and  El  40,  Az  0)  in  which  the  sun  simulator  was  attached  to  the 
terrain  table  and  was  repositioned  as  required  to  provide  the  proper  illu¬ 
mination  conditions  for  each  target  zone. 

For  the  El  20,  Az  180,  and  El  20,  Az  135,  the  sun  simulator 
was  positioned  at  two  different  places.  Since  repositioning  the  sun  simu¬ 
lator  consumed  a  considerable  amount  of  time,  personnel  batching  was  used. 
The  Observers  were  all  run  through  runs  1  -  2  -  3  on  the  west  side  of  the 
terrain,  then  the  sun  simulator  was  repositioned  and  they  were  run  through 
runs  4  -  5  -  6  on  the  east  side  of  the  terrain. 


» 


» 


I 
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For  the  El  20,  Az  90,  the  sun  simulator  was  positioned  at 
four  different  places.  First  runs  1  and  2  were  made.  Then  the  sun  simu¬ 
lator  was  repositioned.  Run  3  was  made,  then  the  sun  simulator  was  re¬ 
positioned.  Runs  4  and  5  were  made,  then  the  sun  simulator  was  reposi¬ 
tioned  one  last  time  for  run  6. 

In  the  other  runs  of  sub- experiment  3,  the  sun  simulator  was 
mounted  in  a  fixed  position  while  the  terrain  table  moved  through  the  light 
beam.  For  the  45  degree  azimuth  runs  (20  degrees  and  40  degrees  elevation) , 
the  Observers  were  batched  so  that  four  of  them  were  taken  through  zones 
I,  II,  and  III  with  the  sun  simulator  positioned  on  the  west  side  of  the 
terrain  table.  The  sun  simulator  was  then  repositioned  to  the  east  side  of 
the  table  and  the  batch  was  taken  through  zones  IV,  V,  and  VI.  For  the  0 
degree  azimuth,  40  degrees  elevation,  the  Observers  ran  all  six  targets 
as  in  the  overcast  sky  case  of  sub-experiment  1.  Each  run  ended  when  the 
Observer  signaled  acquisition. 

On  the  instant  that  the  Observer  signaled  acquisition,  a 
curtain  came  down  in  front  of  him  and  the  sensor;  the  range  and  time  of 
the  acquisition  were  recorded.  The  terrain  and  habitat  were  repositioned 
for  the  next  run.  The  run  was  stopped  by  the  Experimenter  when  the  Observer 
had  overflown  his  target. 

At  the  end  of  each  of  the  Observer's  six  runs,  the  Experimenter 
asked  the  Observer  questions  about  the  target  (location,  number,  color,  and 
direction)  to  verify  valid  acquisition.  This  information  was  recored  on  the 
Experimenter  Check  Sheet  and  also  entered  into  the  computer  through  the  use 
of  the  keyboard.  Then  the  next  run  began. 

4.4.2  Observers 

Observer  selection  for  sub-experiment  3  consisted  of: 

24  Martin  Marietta 
12  Air  Force 
7  Navy 
5  Marines 
48 

These  runs  were  made  from  22  January  1975  to  28  January  1975. 
One  Martin  Marietta  Observer  completed  only  the  first  three  runs,  then  left 
the  premises  during  a  time-out  for  a  sun  simulator  change.  He  could  not  be 
recalled  in  time  to  continue  without  seriously  impacting  the  schedule. 

4.4.3  Terrain  Table  Layout 

The  experiment  utilized  one  of  the  six  terrain  table  configu¬ 
rations  that  were  used  in  sub-experiment  1  and  which  was  also  used  for  sub¬ 
experiment  2  (Configuration  F);  therefore,  all  six  combinations  of  clutter 
and  contrast  were  used,  one  for  each  of  the  six  target  zones.  These  are 
shown  in  Table  4-1. 
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TABLE  4-1.  COMPOSITION  OF  CONFIGURATION  F 


II 

III 

IV 

V 

VI 

HL 

LH 

MH 

HH 

LL 

Target  Zone 


Clutter  was  classified  as  either  low,  medium,  or  high.  The 
levels  of  clutter  were  defined  in  terms  of  the  number  of  target-like  ob¬ 
jects  in  the  immediate  vicinity  of  the  target  —  low  clutter  was  repre¬ 
sented  by  no  trees  in  a  200  meter  radius  circle  about  the  target;  medium 
by  20  trees;  and  high  by  60  trees. 

The  contrast  of  the  individual  targets  with  respect  to  their 
backgrounds  took  two  levels:  a  low-contrast  case  in  which  the  targets 
were  only  slightly  darker  than  the  background;  and  a  high-contrast  case, 
in  which  targets  were  considerably  darker  than  the  background. 

Two  different  colors  were  used  for  the  tank  targets:  dark 
O.D.  (high  contrast)  and  beige  (low  contrast). 

Contrast  was  defined  as  the  difference  between  the  luminance 
of  the  target  and  background  divided  by  the  luminance  of  the  background, 
i.e.,  C  =  (L^  -  Lg)/Lg.  Table  4-II  presents  the  average  contrast  of  the 
three  tanks  with  respect  to  the  background  in  the  six  target  zones. 


TABLE  4- II. 
target  Zone 


NEGATIVE  CONTRAST  RATIO  OF  THE  TARGETS 


IT  III 


Contrast  Ratio  0.31  0.38  0.82  0.78  0.71  0.27 


4.4.4 


Illumination  Conditions 


Uniform  lighting  characteristics  of  overcast  weather,  as  well 
as  directional  lighting  characteristics  of  sunlight  were  simulated.  Over¬ 
cast  weather  was  simulated  using  overhead  fluorescent  lighting.  Clear  sky 
weather  was  simulated  using  the  sun  simulator  to  provide  the  different 
angles  of  illumination.  In  addition,  overhead  fluorescent  lighting  was 
used  to  provide  diffused  light  simulating  skylight  effect. 

Sub-experiment  3  used  six  different  illumination  conditions 
as  shown  in  Table  4-III. 

TABLE  4-III.  ILLUMINATION  CONDITIONS 
Elevation  40  40  20  20  20  20 

Azimuth  45  0  45  90  135  180 


4.4.5 


Measures  Used 


For  each  individual  run,  the  range  and  time  of  acquisition 
were  recorded;  valid  as  well  as  false  acquisitions  and  failures  to  acquire 
targets  were  also  recorded. 

4.5  Results 

Two  working  procedures  were  used  in  the  analysis  of  the  data 
for  sub-experiment  3: 

_1  Any  correct  acquisition  made  at  the  proper  location  was 
considered  valid,  regardless  of  how  many  tanks  were  re¬ 
ported  at  that  location.  Thus,  when  an  Observer  reported 
one,  two,  three,  or  more  tanks  at  a  proper  location  this 
was  recorded  as  a  valid  target  acquisition.  Only  valid 
acquisitions  were  considered  in  the  statistical  compu¬ 
tations  . 

2  All  data  reporting  mean  range  and  the  standard  deviations 
thereof  are  based  on  the  number  of  acquisitions  made,  and 
do  not  include  unsuccessful  acquisition  attempts. 

4.5.1  Analysis  of  Variance  (General  Linear  Model) 

The  two  primary  variables  of  interest  for  analysis  of  this  ex¬ 
periment  were  method  of  search  and  illumination  condition.  The  analysis 
was  approached  using  terrain  table  configuration  F  data  from  sub-experiment 


1  to  complete  the  elevation 
conditions  are  as  follows: 

-  azimuth  set. 

Data  sources  for 

the 

various 

Elevation 

20°, 

Azimuth 

45°  - 

Sub-experiment 

3 

-  48 

Runs 

Elevation 

20°, 

Azimuth 

90°  - 

Sub-experiment 

3 

-  48 

Runs 

elevation 

20°, 

Az imuth 

135°  - 

Sub -experiment 

3 

-  48 

Runs 

Elevation 

20°, 

Azimuth 

180°  - 

Sub -experiment 

3 

-  48 

Runs 

Elevation 

40°, 

Azimuth 

0° 

Sub-experiment 

3 

-  48 

Runs 

Elevation 

40°, 

Azimuth 

45°  - 

Sub -experiment 

3 

-  48 

Runs 

Elevation 

40°, 

Az imuth 

90°  - 

Sub-experiment 

1 

-  48 

Runs 

Elevation 

40°, 

Azimuth 

135°  - 

Sub-experiment 

1 

-  48 

Runs 

Elevation 

40°, 

Azimuth 

180°  - 

Sub-experiment 

1 

-  48 

Runs 

Total 

432 

Runs 

Sub-experiment  3  was  analyzed  using  the  GLM  ANOVA  in  two  ways. 
First,  the  combinations  of  elevation  and  azimuth  were  treated  as  9  levels  of 
one  factor.  The  ANOVA  for  this  approach  is  shown  in  Table  4-IV.  Main  effects 
and  two-way  interactions  are  included  in  the  model.  At  the  .05  level  of 


significance,  only  clutter  and  the  interaction  of  illumination  angle  versus 
Observer  skill  are  significant. 


TABLE  4-IV.  ANALYSIS  OF  VARIANCE  ILLUMINATION 
ANGLE  DIFFERENCE 
(COMBINED  FACTORS  OF  ELEVATION 
AND  AZIMUTH) 


Source 

Sum  of  Squares 

Degrees 

of 

Freedom 

Mean  Square 

F  Ratio 

Illumination  Angle 

36226913.35 

8 

4528364.16 

1.49910 

Assigned  Search  Method 

19708394.55 

3 

6569464.85 

2.17480 

Observer 

649135.97 

1 

649135.97 

.21489 

Clutter 

23064095.11 

2 

11532047.55 

3.81765* 

Contrast 

6370693.37 

1 

6370693.37 

2.10900 

Illumination  Angle/Observer 

52044449.45 

8 

6505556.18 

2.15365* 

Assigned  Search  Method/ 
Contrast 

1669886.35 

3 

556628.78 

.18427 

Observer /Clutter 

4826323.79 

2 

2413161.89 

.79887 

Observer/Contrast 

9769665.73 

1 

9769665.73 

3.23422 

Clutter /Contrast 

4304179.58 

2 

2152089.79 

.71244 

Observer/Assigned  Search 
Method 

9383910.31 

3 

3127970.10 

1.03551 

Assigned  Search  Method/ 
Clutter 

18587985.41 

6 

3097997.56 

1.02558 

Error 

344361636.01 

114 

3020716.00 

*Significant  at  the  .05  level 


Second,  the  experiment  was  analyzed  by  separating  the  factors 
of  elevation  and  azimuth.  In  this  analysis  the  0  degree  azimuth  for  the  40 
degrees  elevation  is  eliminated  since  there  was  no  corresponding  0  degree 
azimuth,  20  degrees  elevation.  The  ANOVA  for  this  approach  is  shown  in 
Table  V.  Main  effects  and  two-way  interactions  are  included  in  the  mo  lei. 

At  the  .05  level  of  significance  only  the  two-way  interactions  of  azimuth 
versus  Observer  skill  and  Observer  skill  versus  contrast  are  significant. 
Clutter  was  not  significant  in  this  analysis.  However,  if  most  of  the  two- 
way  interactions  are  dropped  from  the  model  then  clutter  becomes  a  significant 
variable.  This  indicates  a  possible  problem  implementing  the  GLM  program 
when  a  large  quantity  of  data  is  missing.  The  other  established  primary 
objective  for  sub-experiment  3,  method  of  search,  was  shown  to  be  not  sig¬ 
nificant  by  the  ANOVA  (Tables  4-IV  and  4-V). 


TABLE  4-V.  ANALYSIS  OF  VARIANCE  ILLUMINATION 
ANGLE  DIFFERENCE 
(SEPARATE  FACTORS  OF  ELEVATION 
AND  AZIMUTH) 


Source 

Sum  of  Squares 

Degrees 

of 

Freedom 

Mean  Square 

F  Ratio 

Sun  Elevation 

6664537.47 

1 

6664537.47 

2.31748 

Sun  Azimuth 

10093089.74 

3 

3365363.24 

1.16990 

Assigned  Search  Method 

13441949.35 

3 

4480649.78 

1.55807 

Observer 

1237118.49 

1 

1237118.49 

0.43019 

Clutter 

8910933.25 

2 

4455466.62 

1.54931 

Contrast 

636439.35 

1 

636439.35 

0.22131 

Elevation/ Observer 

6391171.33 

1 

6391171.33 

2.22242 

Elevation/Assigned  Search 
Method 

22866524.68 

3 

7622174.89 

2.65048 

Elevation/ Azimuth 

9360873.88 

3 

3120291.29 

1.08503 

Elevation/Contrast 

2868488.24 

1 

2868488.24 

0.99747 

Elevation/ Clutter 

2142507.53 

2 

1071253.76 

0.37251 

Azimuth/Assigned  Search 
Method 

49859293.61 

9 

5539921.51 

1.92641 

Azimuth/Observer 

25365522.69 

3 

8455174.23 

2.94014* 

Azimuth/ Clutter 

20735511.83 

6 

3455918.63 

1.20174 

Azimuth/Contrast 

7953674.81 

3 

2651224.93 

0.92192 

Observer/Assigned  Search 
Method 

11523430.18 

3 

3841143.39 

1.33569 

Assigned  Search  Method/ 
Clutter 

12751839.88 

6 

2125306.64 

0.73904 

Assigned  Search  Method/ 
Contrast 

18863986.16 

3 

6287995.38 

2.18654 

Observer /Clutter 

7577649.13 

2 

3788824.56 

1.31750 

Ob server /Contrast 

11581689.94 

1 

11581689.94 

4.02733* 

Clutter /Contrast 

5758201.23 

2 

2879100.61 

1.00116 

Error 

198428270.73 

69 

2875771.00 

*S ignif icant  at  the  .05  level 


4.5.2 


Primary  Objectives 


4. 5. 2.1  Search  Method 

4. 5. 2. 1.1  Assigned  Search  Method 

Table  4-VI  shows  the  results  for  the  assigned  search  methods. 

As  in  sub-experiments  1  and  2  there  is  no  significant  difference  in  assigned 
search  methods  either  in  acquisition  range  or  number  of  acquisitions. 


TABLE  4-VI.  ASSIGNED  SEARCH  METHOD 


Method 

Mean 

Range 

<x) 

Standard 

Deviation 

A, 

(o) 

Sample 

Size 

(N) 

DV 

5820m 

1923 

44 

DV  +  WF 

5153m 

1738 

47 

DV  +  NF 

5571m 

1848 

33 

DV  +  VF 

4970m 

1906 

31 

Chi-square  (x^  =  7.60  DF  =  3)  Not  significant 

4.5.2. 1.2  Actual  Search  Method 

Table  4-VII  shows  the  results  of  the  actual  search  method.  As 
in  previous  experiments  there  was  a  tendency  to  use  the  direct  visual  mode. 
However,  in  this  experiment  there  is  no  significant  difference  in  the  actual 
search  modes  in  the  mean  range  of  acquisition. 


TABLE  4-VII.  ACTUAL  SEARCH  METHOD 


Method 

Mean 

Range 

6) 

Standard 

Deviation 

A 

(o) 

Sample 

Size 

(N) 

Misses 

5521m 

1863 

78 

120 

5429m 

1797 

30 

39 

5282m 

1855 

23 

57 

EliBlIi 

5049m 

2006 

24 

61 

Chi-square  (x^  =  6.72  DF  =  3)  Not  significant 
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4. 5. 2. 2  Illumination 

A  major  objective  of  this  study  was  to  examine  the  effects  of 
varying  sun  angle  and  elevation.  When  data  from  sub-experiment  1  is  com¬ 
bined  with  the  data  from  sub-experiment  3,  conditions  of  40  and  20  degrees 
sun  elevation  can  be  considered  at  sun  azimuths  of  45,  90,  135,  and  180 
degrees.  In  addition,  40  degrees  sun  elevation  at  0  degree  azimuth  was 
tested.  (The  physical  setup  of  the  Optical  Laboratory  did  not  allow  the  20 
degrees  elevation,  0  degree  azimuth  case.)  The  results  from  sub-experiment 
3  and  table  configuration  F  of  sub-experiment  1  are  shown  in  Table  4-VIII. 
The  Chi-square  test  was  significant  for  number  of  acquisitions,  with  a 
reduction  of  number  of  acquisitions  as  the  azimuth  was  increased. 


TABLE  4-VIII.  EFFECT  OF  SUN  ELEVATION  AND  AZIMUTH 
ON  TARGET  ACQUISITION 


20°  Sun  Elevation 

40°  Sun  Elevation 

Mean 

Standard 

Mean 

Standard 

Sun 

Range 

Deviation 

Number 

Range 

Deviation 

Number 

Azimuth* 

(x) 

(o) 

Acquisitions 

(x) 

(a) 

Acquisitions 

0° 

(Not  cone 

ucted) 

5669m 

1119 

26 

45° 

5830m 

1796 

24 

5624m 

1379 

22 

90° 

4299m 

1878 

15 

4948m 

1677 

18 

135° 

6048m 

2545 

12 

5163m 

1916 

14 

180° 

4976m 

2412 

10 

5500m 

_ 

2516 

14 

Chi-square  (x^  =  22.78,  DF  =  8)  Significant 


The  ANOVA  (Tables  4-IV  and  4-V)  found  no  significant  difference 
in  acquisition  range  for  elevation  or  azimuth  effects.  This  is  also  evident 
from  inspection  of  Table  4-IX  and  4-X.  The  chi-square  test  for  number  of 
targets  acquired  was  not  significant  for  elevation.  The  ANOVA  for  sub¬ 
experiment  3  indicated  that  the  interaction  of  illumination  angle  with  Ob¬ 
server  skill  was  significant  (Table  4-IV).  Thus,  a  two-way  ANOVA  (Table 
4-XI)  was  conducted  to  test  this  possible  interaction  using  the  actual 
obtained  valued.  Combining  data  from  sub-experiments  1  and  3,  the  results 
are  not  significant  at  the  .05  level. 

TABLE  4-IX.  EFFECT  OF  SUN  ELEVATION  ON 
TARGET  ACQUISITION 
(NOT  SIGNIFICANT  F(l,69)  =  2.32) 


Chi-square  (x^  =  2.23,  DF  =  1)  Not  Significant 


Mean 

Standard 

Range 

Deviation 

Elevation 

(x) 

(a) 

(N) 

20° 

5356m 

2147 

61 

O 

O 

5420m 

1662 

94 

60 


TABLE  4-X.  EFFECT  OF  SUN  AZIMUTH 
ON  TARGET  ACQUISITION 


Sun  Azimuth 
(40°  and  20°) 

Mean 

Range 

(x) 

Standard 

Deviation 

(5) 

Number 

Acquisitions 

0 

5669m 

1119 

26* 

Not  included 
in  GLM  or 

45 

5731m 

1596 

46 

90 

4653m 

1773 

33 

135 

5571m 

2227 

26 

180 

5281m 

2438 

_ 

24 

Chi-square  (x^  =  13.86,  DF  =  3)  Significant 


TABLE  4-XI.  OBSERVER  VERSUS  ILLUMINATION  ANGLE 
(COMBINED  DATA  FROM  SUB-EXPERIMENTS 
1  AND  3) 


Source 

Sum  of  Squares 

Degrees 

of 

Freedom 

Mean  Square 

F  Rat: 

Observer 

52328.19 

1 

52328.19 

0.02 

Illumination  Angle 

25982927.34 

8 

3247865.91 

0.98 

Observer /Illumination 
Angle 

50544153.61 

8 

6318019.20 

1.91 

Error 

452410991.65 

137 

3302270.01 

4. 5. 2. 2.1  Sun  Azimuth 

Effects  of  sun  azimuth  are  mixed.  An  overall  F-test  of  the 
data  indicates  no  statistically  significant  differences.  When  condition  by 
condition  comparisons  are  made,  however,  the  data  fall  into  separate  groups 
The  0,  45,  and  135  degrees  azimuths  give  longer  acquisition  ranges  than  the 
90  and  180  degrees  conditions,  and  approach  significance.  Table  4-X  (which 
combines  data  from  sub-experiment  3  and  table  configuration  F  only  from 
sub-experiment  1)  shows  the  distribution  of  sun  azimuth.  A  chi-square  test 
applied  to  number  of  acquisitions  showed  a  significant  difference  in  that 
more  targets  were  acquired  at  45  and  90  degrees  azimuths.  The  ANOVA  in 
Table  4-V  indicated  an  interaction  between  azimuth  and  Observers.  This 
interaction  was  not  found  to  be  significant  when  a  two-way  ANOVA  was  per¬ 
formed  (Table  4-XII),  possibly  due  to  the  implementation  of  the  GLM  when  a 
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significant  amount  of  data  is  missing.  Due  to  the  low  F  value,  1.01,  found 
in  Table  4-XII,  however,  the  observed  lack  of  significance  is  probably  valid 


TABLE  4-XII.  OBSERVER  VERSUS  AZIMUTH 
(SUB-EXPERIMENT  3) 


Source 

Sum  of  Squares 

Degrees 

of 

Freedom 

Mean  Square 

F  Ratio 

Observer 

117777.72 

1 

117777.72 

0.03 

Azimuth 

11503433.01 

3 

3834477.67 

1.01 

Observer/ 

Azimuth 

11482914.37 

3 

3827638.12 

1.01 

Error 

458302725.54 

121 

3783625.83 

4.5.3  Secondary  Objectives 

4. 5. 3.1  Clutter 

Clutter  was  found  to  be  a  significant  factor  in  the  main  effects 
ANOVA  (Table  4-IV) ,  and  not  in  the  two-way  ANOVA  (Table  4-V) .  However,  as 
variables  were  dropped  from  the  model,  clutter  did  become  significant.  Clutter 
is  significant  in  both  acquisition  range  and  number  of  acquisitions.  For 
acquisition  ranges  there  did  not  appear  to  be  any  significant  difference  be¬ 
tween  levels  of  clutter  when  the  40  degrees  elevation  0  degree  azimuth  data 
is  excluded.  Clutter  followed  the  expected  pattern,  i.e.,  the  acquisition 
range  and  number  of  acquisitions  decreased  as  the  level  of  clutter  increased . 
These  data  are  shown  in  Table  4-XIII  and  4-XIV. 


TABLE  4-XIII.  EFFECT  OF  CLUTTER  ON 
TARGET  ACQUISITION 


Level 

Mean 

Range 

(x) 

Standard 

Deviation 

A 

(a) 

■ 

Low 

5622m 

1885 

80 

Medium 

5340m 

1859 

41 

High 

4925m 

1766 

34 

Chi-square  (x^  =  45,59,  DF  =  2)  Significant 


TABLE  4-XIV.  EFFECT  OF  CLUTTER  (WITHOUT  DATA 
FROM  40  DEGREES  ELEVATION, 

0  DEGREE  AZIMUTH  CASE) 


Level 

Mean 

Range 

(x) 

Standard 

Deviation 

(a) 

m 

Low 

5604m 

1985 

69 

Medium 

5262m 

2019 

32 

High 

4775m 

1842 

28 

Chi-square  (x^  =  35.79,  DF  =  2)  Significant 


4. 5. 3. 2  Contrast 

The  effects  of  contrast  are  shown  in  Table  4-XV;  no  significant 
difference  is  noted  in  the  mean  range  to  acquisition  due  to  contrast.  The 
chi-square  test,  however,  did  show  an  inverse  difference,  with  more  targets 
being  acquired  at  the  low  level. 


TABLE  4-XV.  EFFECTS  OF  CLUTTER 


Mean 

Standard 

Sample 

Range 

Deviation 

Size 

Level 

(5) 

(3) 

(N) 

Low 

5548 

96 

High 

5146 

1 

59 

Chi-square  (x^  =  13.0,  DF  =  1)  Significant 


There  is  an  interaction  between  Observers  and  contrast  indicated 
by  Table  4-V.  This  is  discussed  In  Section  4.5.5.  The  effects  of  clutter/ 
contrast  are  shown  in  Table  4-XVI.  The  ANOVA  was  conducted  to  compare  sub¬ 
experiment  1,  table  configuration  F,  with  sub-experiment  3;  there  is  no  sig¬ 
nificant  difference  in  the  clutter/contrast  effects  at  the  .05  level  of  sig¬ 
nificance.  Thus,  the  data  from  table  configuration  F  for  sub-experiments  1 
and  3  are  combined  for  further  analysis. 


TABLE  4-XVI.  EFFECTS  OF  CLUTTER/CONTRAST 


Clutter /Contrast 

Table 

Configuration  F 
Sub-Experiment  3 

Table 

Configuration  F 
Sub-Experiment  1* 

1 

Table 

Configuration  F 

1  and  3 

LL  Range 

5682 

5764 

5705 

Standard  Deviation 

1616 

1837 

1657 

Number  of  Acquisitions 

28 

11 

39 

ML  Range 

5838 

4920 

5654 

Standard  Deviation 

1675 

1833 

1721 

Number  of  Acquisitions 

28 

7 

35 

HL  Range 

5690 

2442 

5100 

Standard  Deviation 

1061 

622 

1618 

Number  of  Acquisitions 

18 

4 

22 

LH  Range 

5495 

5620 

5544 

Standard  Deviation 

2061 

2216 

2096 

Number  of  Acquisitions 

25 

16 

41 

MH  Range 

2766 

4991 

3508 

Standard  Deviation 

852 

2304 

1678 

Number  of  Acquisitions 

4 

2 

6 

HH  Range 

4068 

5141 

4605 

Standard  Deviation 

2596 

1334 

2047 

Number  of  Acquisitions 

6 

6 

12 

*Includes  sun  angle  data  only 


4.5.4  Additional  Results 

Trained  Observers  made  90  correct  acquisitions;  untrained  made 
65.  Mean  overall  range  of  acquisition  for  trained  Observers  was  5430  with  a 
standard  deviation  of  1898  meters;  for  all  untrained  Observers  the  mean 
range  was  5347  with  a  standard  deviation  of  1824  as  shown  in  Table  4-XVII. 
Untrained  Observers  exceeded  the  trained  Observers  except  at  the  45  degree 
azimuth  wherein  the  trained  Observers  detected  them  at  the  longest  range. 

For  both  groups,  the  worst  azimuth  was  90  degrees.  The  results  are  shown 
in  Table  4-XVIII.  Contrast  influenced  the  untrained  Observer's  ability  to 
detect  the  targets;  the  high  level  of  contrast  produced  shorter  detection 
ranges.  The  effect  of  contrast  on  the  trained  Observer  performance  is  not 
significant,  as  seen  in  Table  4-XIX.  As  shown  in  Table  4-XX,  for  the  com¬ 
bined  factors  of  elevation  and  azimuth,  trained  Observers  were  definitely 
better  at  20/45,  20/180,  40/45  and  40/135  degrees.  Untrained  Observers 
were  considerably  better  at  20/135,  40/90  and  40/180  degrees.  There  is  no 
significant  difference  between  Observers  at  20/90,  and  40/0  degrees.  Data 
are  not  available  regarding  differences  between  individuals  or  groups  within 
either  particular  group  of  Observers. 
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TABLE  4-XVII.  OBSERVER  RESULTS 


Mean 

Standard 

1S9 

Range 

Deviation 

ESI 

Observer 

(x) 

(S) 

warn 

Untrained 

5347m 

1824 

65 

Trained 

5430m 

1898 

90 

Chi-square  (x^  =  5.8,  DF  =  1)  Significant 


TABLE  4-XVIII.  OBSERVER  INTERACTION 
WITH  AZIMUTH 


Azimuth 

Untrained 

Trained 

45° 

5179m 

6194m 

90° 

5062m 

4499m 

135° 

5292m 

5131m 

180° 

5580m 

5029m 

TABLE  4-XIX.  OBSERVERS  VERSUS  CONTRAST 


Source 

Sum  of  Squares 

Degrees 

of 

Freedom 

Mean  Square 

F  Ratio 

Observer 

305.02 

1 

305.02 

0.00 

Contrast 

6096103.41 

1 

6096103.41 

1.59 

Observer/Contrast 

13176982.12 

1 

13176982.12 

3.43* 

Error 

479975879.33 

125 

3839807.03 

*Significant  at  .05  level 
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TABLE  4-XX.  OBSERVER  INTERACTION  WITH 
ILLUMINATION  ANGLE 


Elevation/Azimuth 

Untrained 

Trained 

20°  45° 

5188m 

6288m 

90° 

4340m 

4271m 

135° 

5702m 

4865m 

180° 

3859m 

5720m 

O 

O 

o 

O 

5612m 

5747m 

45° 

5172m 

6075m 

90° 

6507m 

4636m 

135° 

4779m 

5317m 

180° 

6564m 

4436m 

Conclusions 
Primary  Objectives 

1^  In  the  ANOVA  for  sub-experiment  3  (Tables  4-IV  and  4-V)  the 
assigned  method  of  search  was  not  significant.  There  were 
six  interactions  tested: 

Combined  Elevation  and  Azimuth 

a.  Assigned  search  method  versus  clutter 

Assigned  search  method  versus  contrast 

c_  Assigned  search  method  versus  Observer 

Separate  Elevation  and  Azimuth 

<i  Assigned  search  method  versus  elevation 

e_  Assigned  search  method  versus  azimuth 

f_  Assigned  search  method  versus  Observer 

In  the  six  interactions  tested  the  assigned  search  method 
did  not  develop  a  significant  F  ratio.  Therefore,  it  is 
concluded  that  the  assigned  search  method  did  not  affect 
the  acquisitions.  In  the  case  of  the  actual  search  method 
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utilized,  there  was  a  considerable  difference  in  the  num¬ 
ber  of  acquisitions  made,  with  the  direct  visual  (DV) 
method  producing  many  more.  In  this  sub-experiment,  as 
in  some  of  the  others,  the  option  given  regarding  the  use 
of  the  sensor-aids  in  the  WF,  NF  and  VF  runs  was  by-passed 
by  the  Observer  in  many  runs,  thereby  influencing  the  num¬ 
ber  of  acquisitions  for  each  of  the  search  methods  used. 
Tables  4-VI  and  4-VII  are  the  basis  for  such  conclusions. 

2_  Illumination  Angle  -  The  effects  of  varying  sun  angle 

(azimuth/elevation)  were  established  as  a  major  objective 
of  this  sub-experiment  and  nine  different  illumination 
angles  (listed  in  Paragraph  4,5.1)  were  utilized  to  deter¬ 
mine  their  influence  on  target  acquisition.  As  a  main 
effect,  neither  of  these  factors  produced  a  significant 
F-number  in  the  ANOVA  computations  for  sub-experiment  3 
(Tables  4-IV  and  4-V) .  However,  significance  of  azimuth 
was  shown  in  the  chi-square  test.  The  45  degrees  azimuth 
produced  the  greatest  number  of  acquisitions  as  well  as  the 
longest  range  at  acquisition,  as  shown  in  Table  4-X;  the 
other  azimuths  and  elevations  tested  were  not  markedly 
different  from  each  other,  although  the  number  of  acquisi¬ 
tions  for  40  degrees  elevation  produced  a  somewhat  higher 
number  of  acquisitions  than  20  degrees.  An  interaction 
was  noted  between  illumination  angle  and  Observer  in 
Table  4-IV  and  another  interaction  between  azimuth  and  Ob¬ 
server  was  displayed  in  Table  4-V.  A  two-way  ANOVA  con¬ 
ducted  for  the  possible  interaction  of  illumination  angle 
and  Observer  (Table  4-XI)  did  not  produce  a  significant  F 
ratio.  Paragraph  4. 5. 2, 2_  contains  a  rather  detailed  dis¬ 
cussion  of  the  various  considerations  of  the  illumination 
angle  test  results,  particularly  with  regard  to  the  mixing 
of  azimuth  effects.  It  is  concluded  that  only  minor  in¬ 
fluence  on  target  acquisition  was  experienced  under  the 
test  conditions  established  for  sub-experiment  3. 

4.6.2  Secondary  Objectives 

_1  Throughout  the  test  runs  for  sub-experiment  3,  clutter 
exerted  a  significant  influence  on  target  acquisition  in 
several  different  fashions.  As  a  main  effect  (Table  4-IV) 
clutter  influenced  the  range  at  acquisition  and  the  number 
of  acquisitions  as  shown  in  Tables  4-XIII  and  4-XIV  where 
clutter  was  analyzed  both  with  and  without  the  40  degrees 
elevation  and  0  azimuth.  The  expected  pattern  was  followed 
showing  that  low  clutter  would  have  the  least  effect,  me¬ 
dium  clutter  the  next  stronger,  and  high  clutter  would 
have  the  strongest  influence.  This  secondary  objective  has 
been  determined  positive. 
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1_  Contrast  -  The  other  secondary  objective  of  this  sub¬ 
experiment,  contrast,  did  not  show  a  significant  F  ratio  in 
the  ANOVA  displayed  in  Tables  4-IV  and  4-V.  However,  the 
chi-square  test  showed  significance  (Table  4-XV)  with  the 
number  of  acquisitions  being  considerably  higher  with  high 
contrast  between  target  and  background.  The  interaction 
between  contrast  and  Observer,  first  noted  in  Table  4-V, 
was  investigated  further  with  a  two-way  ANOVA  which  pro¬ 
duced  a  significant  F-number  (Table  4-XIX) .  This  effect 
was  more  notable  with  the  untrained  Observers  than  with  the 
trained.  For  the  established  parameters  used  in  sub-experi¬ 
ment  3,  the  data  pertaining  to  contrast  effects  is  incon¬ 
clusive. 

4.6.3  Hypothesis  Correlations 

1^  Clutter  -  This  hypothesis  was  supported  as  discussed  in 
Paragraph  4. 6. 2,1^  above. 

_2  Contrast  -  This  hypothesis  was  not  supported  by  sub-experi¬ 
ment  3,  as  discussed  in  Paragraph  4. 6. 2, 2,  above. 

.3  Clutter/Contrast  -  The  first  portion  of  this  hypothesis 
was  partially  supported  in  that  clutter  interacted  with 
contrast  such  that  medium  and  high  clutter  conditions 
differentially  degraded  target  acquisition.  However,  this 
was  not  to  a  large  degree.  The  second  part  of  the  hypoth¬ 
esis  is  not  supported  under  the  conditions  established  for 
this  sub-experiment.  Under  the  conditions  of  high  contrast, 
range  at  acquisition  was  greater  with  high  clutter  than 
with  medium,  but  less  than  with  low.  This  was  evidenced 
in  sub-experiment  3,  sub-experiment  1  (Table  Configuration 
F  only) ,  and  also  when  these  two  tests  were  combined  as 
shown  in  Table  4-XVI.  Under  low  contrast  conditions,  there 
was  no  significant  difference  in  range  at  acquisition  in 
sub-experiment  3  although  significance  was  developed  in 
sub-experiment  1  with  the  Table  F  configuration. 

4_  Illumination  Angle  -  Effects  of  shadow  will  aid  acquisi¬ 
tion  at  low  clutter,  but  will  hinder  acquisition  with  high 
clutter. 

Since  illumination  angle  was  a  primary  objective  of  this 
sub-experiment,  a  discussion  of  the  effects  of  shadow  is 
contained  in  Paragraph  4. 6. 2, 2_,  above.  No  significant 
interaction  was  noted  between  illumination  angle  and  clutter 
in  the  ANOVA  (Tables  4-IV  and  4-V).  However,  two  chi- 
square  tests  were  calculated  to  evaluate  clutter  both  with 
and  without  the  40  degree  elevation  and  0  degree  azimuth. 

In  both  cases  the  chi-square  test  proved  significant  as 
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shown  in  Tables  4-XIII  and  4-XIV.  In  as  much  as  the  re¬ 
sults  are  similar  in  both  tests  (i.e.,  acquisition  range 
and  number  of  acquisitions  decreased  as  clutter  was  in¬ 
creased)  it  would  appear  that  this  hypothesis  was  not  sup¬ 
ported.  Also,  this  hypothesis  was  not  supported  by  the  in¬ 
formation  discussed  in  Paragraph  4.6.1,_2,  above. 

4.6.4  Additional  Conclusions 

In  this  sub-experiment,  the  trained  Observers  were  significantly 
better  at  target  acquisition  than  the  untrained  Observers,  in  the  number  of 
acquisitions.  In  both  Tables  4-IV  and  4-V,  a  significant  F-number  was  noted 
for  the  interaction  of  Observer  with  illumination  angle,  Observer  with  azi¬ 
muth,  and  Observer  with  contrast;  therefore,  these  three  interactions  were 
analzyed  further.  The  latter  of  these  is  discussed  in  Paragraph  4. 6. 2, 2., 
above.  The  comparisons  of  Observers  with  azimuth  alone  or  with  a  combination 
of  elevation/azimuth  showed  a  mixing  of  results  to  the  effect  that  untrained 
Observers  obtained  approximately  the  same  results  as  the  trained.  Sub-ex¬ 
periment  3  showed  only  minor  improvement  by  the  use  of  trained  Observers 
over  untrained  as  to  range  of  acquisition,  but  the  trained  Observers  dis¬ 
played  a  definite  advantage  in  number  of  acquisitions.  Differences  in  the 
homogeneity  of  the  groups  could  have  been  a  partial  cause  of  these  mixed 
results;  however,  the  data  needed  to  evaluate  this  factor  are  not  available. 
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5.0 


SUB-EXPERIMENT  4 


5.1  Objectives 

As  stated  in  the  IB1  Project  Plan  the  primary  objectives  of  sub¬ 

experiment  4  were  to  determine  target  acquisition  performance  for  rotary-wing 
profile  as  a  function  of: 

1.  Method  of  search 
Target  area  clutter 

,3  Target-to-background  contrast 

4.  Pop-up  range  to  target . 

The  secondary  objective  was  determination  of  target  acquisition 
performance  as  a  function  of  pop-up  altitude. 

5.2  Experimental  Design 

The  experiment  examined  in  detail  the  performance  of  three 
search  methods  under  four  different  conditions  of  varying  clutter/contrast 
combinations  and  nine  different  altitude/ range  combinations.  The  three 
search  methods  were: 

1  Direct  visual  search  without  search  aids 

2_  Direct  visual  search  in  parallel  with  search  using  a  tele¬ 
vision  sensor  using  a  variable  FOV  (8  degrees  to  2  degrees 
zoom)  (VF) 

.3  Direct  visual  search  in  parallel  with  search  using  a  simu¬ 
lated  8  power  stabilized  magnifying  optical  device. 

Two  Observers,  one  trained  and  one  untrained,  ran  identical  run 
sets,  giving  a  total  of  864  experimental  runs.  Additional  considerations, 
such  as  inter-subject  variability  within  each  group  of  subjects,  were  not 
addressed  in  this  study. 

(4  table  configurations)  x  (3  search  modes)  x 
(4  clutter/contrast  conditions)  x  (9  range/ 
altitude  combinations)  x  (2  Observers  running 
identical  runs)  =  864  experimental  runs. 

Figure  5-1  diagrams  the  design  of  this  experiment. 

5.3  Hypotheses 

Prior  to  the  experiments,  the  following  hypotheses  relative 
to  sub-experiment  4  were  postulated  (reference  Project  Plan  IB1  of 
October  1974,  Annex  K,  Section  5). 
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DIRECT  VISUAL 
STABILIZED  OPTICS 
E/0  -  ELECTRO  OPTICAL 


FACTORS  CONSIDERED 

METHOD  OF  SEARCH  -  3  TYPES 
CLUTTER  -  2  LEVELS 
CONTRAST  -  2  LEVELS 
POP-UP  RANGE  -  3  LEVELS 
POP-UP  ALTITUDE  -  3  LEVELS 

OBSERVERS  REQUIRED 

54  FOR  EACH  OF  4  CONFIGURATIONS  OF  TERRAIN  TABLE 

MEASURES  OF  EFFECTIVENESS 
MEAN  TIME  TO  ACQUISITION 
PERCENT  OF  TARGETS  ACQUIRED 
NUMBER  OF  FALSE  ACQUISITIONS 

NUMBER  OF  TARGETS 
3  PER  AREA 

NUMBER  OF  EXPERIMENTAL  RUNS 

(108  CELLS)  x  (4  TABLE  CONFIGURATIONS)  x 
(2  OBSERVERS  RUNNING  IDENTICAL  RUN-SETS)  = 

864  EXPERIMENTAL  RUNS 


Figure  5-1.  Design  of  Sub-experiment  4 


.1  Clutter  will  affect  target  acquisition  in  the  order  of  best 
acquisition  to  worst  as  low,  medium,  and  high 

2_  High  contrast  will  produce  better  target  acquisition  than 
low  contrast 

_3  Clutter  will  interact  with  contrast  such  that  medium  and  high 
clutter  conditions  will  differentially  degrade  target  acqui¬ 
sition;  at  equivalent  levels  of  contrast  target  acquisition 
will  be  lower  with  clutter. 

5.4  Method  of  Accomplishment 

5.4.1  General  Description 

Each  of  the  three  search  methods  was  used  by  different  Observers 
against  targets  positioned  on  the  terrain  table. 

The  habitat  was  brought  to  the  simulated  altitude  (800  ft, 

1300  ft,  or  1800  ft)  and  fixed  in  position.  The  run  was  started  by  the 
Experimenter  at  which  time  the  curtain  was  raised  and  the  terrain  remained 
at  a  fixed  range  (1500m,  2850m,  or  4200m).  The  Observer  searched  until  he 

found  the  targets  or  for  a  maximum  of  one  minute. 1  Each  Observer  made  four 

separate  runs. 

Each  run  posed  a  different  situation  of  clutter/contrast  while 
the  illumination  was  maintained  constant.  Four  different  zones  of  the 
terrain  table  and  four  levels  of  clutter/contrast  were  used.  Four  table 
setups  were  prepared  so  that  each  target  zone  received  each  of  the  combi¬ 
nations  of  clutter  and  contrast. 

The  reason  for  the  choice  of  four  levels  of  clutter/contrast, 
rather  than  the  six  levels  used  in  sub-experiment  1,  was  to  present  a 
balanced  set  of  stimuli  to  the  Observers.  The  two  levels  of  clutter/contrast 
which  were  omitted  were  determined  from  the  results  of  sub-experiment  1, 

i.e.,  high  clutter,  high  contrast;  and  high  clutter,  low  contrast. 2 


It  is  recognized  that  in  a  tactical  situation  aircraft  survival  would 
ordinarily  dictate  a  much  shorter  search  time  in  the  pop-up  mode.  To 
satisfy  experimental  objectives,  however,  a  relatively  long  search  time  was 
required  to  assure  that  detection  probability  did  not  become  time-truncated. 
The  one-minute  figure  was  determined  based  on  similarity  with  the  available 
search  time  ip  the  fixed  wing  experiment  (57  to  63  seconds)  and  the  proba¬ 
bility  that  most  acquisitions  would  occur  in  30  seconds  or  less. 


Initially,  high  clutter,  low  contrast  and  low  clutter,  high  contrast  were 
selected  for  omission,  since  these  were  the  expected  "outliers,"  i.e., 
lowest  acquisition  rate  and  highest  acquisition  rate.  Subsequent  analysis 
of  the  results  of  sub-experiment  1,  however,  revealed  that  this  was  not  the 
case. 
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The  Observers  searched  each  configuration  of  the  terrain  table, 
using  all  combinations  of  pop-up  range,  pop-up  altitude,  and  search  method. 
On  the  instant  that  the  Observer  signaled  acquisition,  a  curtain  came  down 
in  front  of  him  and  the  elapsed  time  for  the  acquisition  was  recorded.  The 
terrain  and  habitat  were  repositioned  for  the  next  run.  The  run  was  stopped 
by  the  Analog  Computer  Operator  after  one  minute  if  the  Observer  failed  to 
acquire  the  targets. 

At  the  end  of  each  of  the  four  runs,  the  Experimenter  asked 
the  Observer  questions  about  the  target  (location,  number,  color,  and 
direction)  to  verify  correct  acquisition.  This  information  was  recorded  on 
the  Experimenter  Check  Sheet  and  also  entered  into  the  computer  through  the 
use  of  the  keyboard.  Then  the  next  run  began. 

5.4.2  Observers 

Observer  selection  for  sub-experiment  4  consisted  of: 

117  Martin  Marietta 
64  Army 
35  Navy 
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The  runs  were  made  from  10  February  1975  to  26  February  1975.  Martin 
Marietta  supplied  substitutes  for  nine  experienced  Observers  who  failed  to 
arrive  on  schedule.  These  substitutes  were  experienced  pilots  or  air  crew¬ 
men  with  recent  helicopter  flight  time. 

5.4.3  Terrain  Table  Layout 

Sub-experiment  4  used  terrain  table  configurations  G,  H,  I, 
and  J.  Each  configuration  was  divided  into  four  separate  target  zones. 

Each  zone  represented  a  different  combination  of  clutter/contrast ;  these 
combinations  were  rotated  as  shown  in  Table  5-1. 


TABLE  5-1.  CLUTTER/CONTRAST  COMPOSITION 
OF  CONFIGURATIONS  G  THROUGH  J 


Target 

Zone 

G 

H 

I 

J 

I 

LL 

ML 

LH 

MH 

II 

ML 

LH 

MH 

LL 

III 

LH 

MH 

LL 

ML 

IV 

MH 

LL 

ML 

LH 

Clutter  was  classified  as  either  low,  medium,  or  high.  The 
levels  of  clutter  were  defined  in  terms  of  the  number  of  target-like  objects 
in  the  immediate  vicinity  of  the  target  —  low  clutter  was  represented  by 
no  trees  in  a  200  meter  radius  circle  about  the  target;  medium  by  20  trees; 
and  high  by  60  trees. 

The  contrast  of  the  individual  targets  with  respect  to  their 
backgrounds  took  two  levels:  a  low-contrast  case  in  which  the  targets  were 
only  slightly  darker  than  the  background;  and  a  high-contrast  case,  in  which 
targets  were  considerably  darker  than  the'  background. 

Two  different  colors  were  used  for  the  tank  targets:  dark 
O.D.  (high  contrast)  and  beige  (low  contrast). 

The  different  contrast  levels  were  achieved  by  varying  the 
luminance  of  both  the  targets  and  the  backgrounds.  Contrast  was  defined 
as  the  difference  between  the  luminance  of  the  target  and  background  divided 
by  the  luminance  of  the  background,  i.e.,  C  =  (LT-L^)/Lg.  Table  5-II 
presents  the  average  contrast  of  the  three  target  tanks  in  each  zone  with 
respect  to  the  background  for  each  configuration. 

TABLE  5-II.  NEGATIVE  CONTRAST  RATIO  OF 
THE  TARGETS  IN  THE  DIFFERENT  TARGET 
ZONES  FOR  CONFIGURATIONS  G  THROUGH  J 


Target 

Zone 

G 

H 

I 

J 

I 

0.20 

0.32 

0.63 

0.61 

II 

0.28 

0.64 

0.67 

0.31 

III 

0.66 

0.71 

0.30 

0.36 

IV 

0.67 

0.28 

0.27 

0.65 

5.4.4  Illumination  Condition 

Overcast  condition  was  used  for  all  runs  in  sub-experiment  4. 
Overhead  fluorescent  lighting  was  used  producing  500  foot-candles  at  the 
terrain  table  surface. 

5.4.5  Measures  Used 

For  each  individual  run,  the  time  of  acquisition  was  recorded; 
valid  as  well  as  false  acquisitions  and  failures  to  acquire  targets  were 
also  recorded. 
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5.5  Results 

Two  working  procedures  were  used  in  the  analysis  of  the  data 
for  sub-experiment  4: 

1_  Any  correct  acquisition  made  at  the  proper  location  was 
considered  valid,  regardless  of  how  many  tanks  were  re¬ 
ported  at  that  location.  Thus,  when  an  Observer  reported 
one,  two,  three,  or  more  tanks  at  a  proper  location  this 
was  recorded  as  a  valid  target  acquisition.  Only  valid 
acquisitions  were  considered  in  the  statistical  computa¬ 
tions. 

2  All  data  reporting  mean  or  median  ranges  (median  ranges  are 
employed  since  sharply  skewed  distributions  are  more  repre¬ 
sentable  by  median  values  than  mean  values)  and  standard 
deviations  thereof  are  based  upon  the  number  of  acquisi¬ 
tions  made,  and  do  not  include  unsuccessful  acquisition 
attempts. 

The  dominant  factors  in  this  first  of  two  helicopter  experi¬ 
ments  were  table  configuration,  method  of  search,  helicopter  altitude, 
range.  Observer  skill,  clutter,  and  contrast.  In  this  experiment,  the 
observed  response  was  detection  time  in  seconds;  range  was  fixed.  Since 
the  distribution  of  time  was  highly  skewed,  a  logarithmic  transformation 
was  applied  to  data  before  the  ANOVA  was  conducted  (see  Appendix  D) .  The 
percentage  of  acquisition  in  this  sub-experiment  was  significantly  higher 
(90  percent)  than  in  sub-experiments  1,  2,  and  3  (40  percent).  Out  of  864 
trials,  781  acquisitions  were  recorded. 

5.5.1  Analysis  of  Variance  (General  Linear  Model) 

Table  5-III  shows  the  ANOVA  for  sub-experiment  4.  All  main 
effects  and  two-way  interactions  were  included  in  the  model.  At  the  .05 
level  of  significance  all  the  main  effects  except  altitude  were  significant. 
Five  two-way  interactions  (table  versus  range,  table  versus  contrast,  method 
of  search  versus  range,  range  versus  clutter,  and  clutter  versus  contrast) 
were  significant  at  the  .05  level. 


TABLE  5-III.  ANOVA 


Source 

Sum  of 
Squares 

Degrees  of 
Freedom 

Mean 

Square 

F  Ratio 

Table 

1.60387 

3 

.54362 

7.55512* 

Assigned  Search  Method 

2.60387 

2 

1.36071 

19.22911* 

Altitude 

0.21298 

2 

.10649 

1.50490 

Range 

15.22001 

2 

7.61000 

107.54233* 

Observer 

1.66511 

1 

1.66511 

23.53085* 
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TABLE  5-III.  ANOVA  (Cont) 


Source 

Sum  of 
Squares 

Degrees  of 
Freedom 

Mean 

Square 

F  Ratio 

Clutter 

7.04735 

1 

7.04735 

99.59105* 

Contrast 

1.86038 

1 

1.86038 

26.29034* 

Table/Assigned  Search  Method 

0.61881 

6 

0.10314 

1.45748 

Table/Altitude 

0.31562 

6 

0.05260 

0.74337 

Table /Range 

1.17627 

6 

0.19604 

2.77045* 

Table /Ob server 

0.17232 

3 

0.05744 

0.81173 

Table /Clutter 

0.45225 

3 

0.15075 

2.13035 

Table /Contrast 

1.53146 

3 

0.51049 

7.21406* 

Assigned  Search  Method/ 
Altitude 

0.24707 

4 

0.06177 

0.87290 

Assigned  Search  Method/Range 

1.93074 

4 

0.48269 

6.82118* 

Assigned  Search  Method/ 
Observer 

0.10981 

2 

0.05491 

0.77591 

Assigned  Search  Method/ 
Clutter 

0.05466 

2 

0.02733 

0.38622 

Assigned  Search  Method/ 
Contrast 

0.15363 

2 

0.07682 

1.08554 

Altitude/ Range 

0.38346 

4 

0.07586 

1.87210 

Altitude /Ob server 

0.08214 

2 

0.04107 

0.58041 

Altitude /Clutter 

0.12836 

2 

0.06418 

0.90700 

Alt i tude / Cont  r as  t 

0.08110 

2 

0.04055 

0.57306 

Range /Ob server 

0.13760 

2 

0.06880 

0.57227 

Range/Clutter 

0.59498 

2 

0.29749 

4.20404* 

Range /Contrast 

0.37087 

2 

0.18544 

2.62052 

Observer/Clutter 

0.00564 

1 

0.00564 

0.07969 

Observer /Contrast 

0.04835 

1 

0.04835 

0.68329 

Clutter /Contrast 

3.14467 

1 

3.14467 

44.43951* 

ERROR 

50.10014 

708 

0.07076 

*Significant  at  the  .05  level 


5.5.2 


Primary  Objectives 


5. 5.2.1  Assigned  Search  Methods 

The  assigned  search  method  was  found  to  be  significant  in  the 
ANOVA  using  the  GLM.  The  direct  visual  (DV)  mode  resulted  in  the  shortest 
detection  time  and  the  electro-optical  (E/0)  television  aid,  the  longest. 

The  difference  between  the  stabilized  optics  (SO)  mode  and  the  E/0  mode  was 
not  significant.  There  was  no  significant  difference  in  the  number  of 
acquisitions  per  assigned  search  method  as  indicated  in  the  chi-square  test. 
Table  5-IV  shows  the  assigned  search  method  results. 


TABLE  5-IV.  ASSIGNED  SEARCH  METHOD  RESULTS 
(SIGNIFICANT  DIFFERENCE 
F  (2,708)  =  19.23) 


Assigned 
Search  Method 

Mean 

Time 

(x) 

Median 
(X. 50) 

Standard 

Deviation 

(o) 

Sample 

Size 

(N) 

DV 

5.24s 

2.50 

7.91 

261 

DV  +  SO 

6.35s 

3.80 

6.99 

260 

DV  +  EO 

8.21s 

3.50 

10.61 

260 

Chi-square  (x^  =  0.03,  DF  =  2)  Not  significant 


Also,  there  was  an  interaction  between  assigned  search  method 
and  range.  As  the  range  increased  the  detection  time  also  increased.  The 
detection  time  for  the  DV  mode  increased  slightly  as  the  range  increased; 
however,  for  the  other  modes  the  time  increased  significantly  as  the  range 
increased.  Table  5-V  presents  the  log  values  for  the  various  combinations 
of  assigned  search  method  and  range.  Table  5-VI  shows  the  results  of  the 
ANOVA. 


TABLE  5-V.  EFFECT  OF  ASSIGNED  SEARCH  METHOD 
BY  RANGE  (IN  LOG  VALUES) 


Assigned 

Range 

Search  Method 

1500m 

2850m 

4200m 

T 


DV 

DV  +  SO 


DV  +  EO 


0.52 

0.59 

0.54 


0.70 

0.75 

0.79 


0.71 

1.01 

0.87 


TABLE  5- VI.  ANOVA  -  ASSIGNED  SEARCH  METHOD 
VERSUS  RANGE 


Source 

Sum  of 
Squares 

Degrees  of 
Freedom 

Mean 

Square 

F  Ratio 

Assigned  Search  Method 

2.73530 

2 

1.36765 

14.98* 

Range 

13.01692 

2 

6.50846 

71.27* 

Assigned  Search  Method 
x  Range 

1.97281 

4 

0.49320 

5.40* 

Error 

70.50258 

772 

0.09132 

^Significant  at  the  .05  level 


5. 5. 2. 2 


Actual  Search  Method 


As  in  the  fixed  wing  experiments,  there  was  a  tendency  for  the 
Observers  to  disregard  the  aid  and  go  to  the  DV  mode.  In  fact  the  percent¬ 
age  of  targets  acquired  in  this  experiment  using  the  DV  mode  was  over  double 
that  for  the  fixed  wing  experiments.  Approximately  90  percent  of  the 
acquisitions  were  made  using  the  DV  mode.  The  DV  mode  resulted  in  the 
shortest  detection  time  and  the  E/0  the  longest.  Experimenters  report  that 
at  the  1500  meter  range,  even  with  clutter,  there  was  little  need  to  use  a 
search  aid.  At  the  2850  meter  range,  some  Observers  did  use  the  aid.  It 
was  only  at  the  4200  meter  range,  especially  at  the  800  foot  elevation, 
that  the  aid  was  used  to  any  extent.  Table  5-VII  shows  the  ANOVA  for  the 
actual  search  method  and  Table  5-VIII  shows  the  actual  search  method 
result. 


TABLE  5-VII.  ANOVA  ACTUAL  SEARCH  METHOD 


Sum  of 

Degrees  of 

Mean 

Source 

Squares 

Freedom 

Square 

F  Ratio 

Actual  Method  of  Search 

20896.94 

2 

10445.47 

211.6* 

Error 

38407.41 

778 

49.36 

*Significant  at  the  .05  level 


TABLE  5- VIII.  ACTUAL  SEARCH  METHOD  RESULTS 
(SIGNIFICANT  DIFFERENCE 
F(2,780)  =  211.6) 


Method 

Mean 

Time 

(x) 

Median 

(X.50) 

Standard 

Deviation 

(5) 

Sample 

Size 

(N) 

DV 

4.49s 

2.6 

5.94 

660 

DV  +  SO 

14.37s 

10.9 

9.10 

64 

DV  +  EO 

22.29s 

19.2 

13.37 

57 

Chi-square  (x^  =  81.15,  DF  =  2)  Significant 


5. 5. 2. 3  Clutter /Contrast 

The  effects  of  clutter  and  contrast  as  well  as  the  interaction 
between  the  two  factors  were  found  to  be  significant. 

The  four  conditions  of  clutter /contrast  used  were  low/ low 
(LL) ,  medium/low  (ML),  low/high  (LH)  and  medium/high  (MH) .  Table  5-IX 
presents  the  mean  data  by  clutter  and  contrast  for  each  table. 


TABLE  5-IX.  CLUTTER/CONTRAST  EFFECTS 
BY  TABLE  SETUP 


The  conditions  of  low  clutter  and  low  contrast  resulted  in  shorter  detec 
tion  times  than  did  the  medium  clutter  and  high  contrast  conditions  (see 
Tables  5-X  and  5-XI) . 


TABLE  5-X.  CLUTTER 

(SIGNIFICANT  DIFFERENCE  F(l,704  -  99.59) 


Mean 

Standard 

Sample 

Time 

Median 

Deviation 

Size 

Level 

(5) 

(X.  50) 

(o) 

(N) 

Low 

5.05s 

7.04 

416 

Medium 

8.35s 

10.03 

365 

Chi-square  (\2  33.32,  DF  -  2)  Significant 


TABLE  5-XI.  CONTRAST 

(SIGNIFICANT  DIFFERENCE  F (1,708)  -  26.29) 


Level 

Mean 

Time 

(5) 

Median 

(X.50) 

Standard 

Deviation 

(a) 

Sample 

Size 

(N) 

Low 

5.75s 

1 

7.93 

405 

High 

7.50s 

9.43 

376 

Chi-square  (x  *  10.45,  DF  *  1)  Significant 


At  the  low  condition  of  clutter  the  acquisition  times  for  low  and  high  con¬ 
trast  are  not  significant;  at  the  high  condition  of  clutter  they  are  sig¬ 
nificant.  The  ANOVA  for  clutter  and  contrast  is  shown  in  Table  5-XII. 
Table  5-XIII  shows  the  mean  detection  time  for  the  four  combinations  of 
clutter  and  contrast. 


TABLE  5-XII.  CLUTTER  VERSUS  CONTRAST 


Source 

Sum  of 
Squares 

Degrees  of 
Fx  iedom 

Mean 

Square 

F.  Ratio 

Clutter 

5.51236 

1 

5.51236 

54.14* 

Contrast 

1.44721 

1 

1.44721 

14.21* 

Clutter  x  Contrast 

2.68823 

1 

2.68823 

26.40* 

Error 

79.10612 

777 

0.10181 

♦Significant  at  the  .05  level 


TABLE  5-XIII.  EFFECT  OF  CLUTTER 
ON  CONTRAST 


Contrast 

Clutter 

Low 

High 

Low 

5.57 

5.97 

Medium 

4.51 

11.15 

5. 5. 2. 4  Additional  Interactions 

There  was  also  an  interaction  between  clutter  and  range  and 
between  contrast  and  table  configuration.  As  the  range  increased,  the 
change  in  effect  of  clutter  became  greater  as  shown  in  Table  5-XIV. 


TABLE  5-XIV.  EFFECT  OF  RANGE  AND 

CLUTTER  (IN  LOG  VALUES) 


Range 

Clutter 

Low 

Medium 

1500M 

0.50 

0.61 

2850M 

0.65 

0.86 

4200M 

0.78 

0.98 

The  effects  of  clutter  and  contrast  were  not  uniform  between 
terrain  table  configurations  as  shown  in  Table  5-IX.  The  effects  of  con¬ 
trast  on  table  configuration  was  significant  as  seen  in  Table  5-XV. 

TABLE  5-XV.  TABLE  CONFIGURATION  VERSUS  CONTRAST 


Source 

Sum  of 
Square 

Degrees  of 
Freedom 

Mean 

Square 

F  Ratio 

Table 

1.08100 

3 

0.36033 

3.30* 

Contrast 

1.03026 

1 

1.03026 

9.44* 

Table  x  Contrast 

1.83017 

3 

0.58006 

9.13 

Error 

84.35666 

773 

0.10913 

*Significant  at  the  .05  level 
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5. 5.2. 5 


Range 


Range  was  shown  to  be  a  significant  factor  in  the  ANOVA  pre¬ 
sented  in  Table  5-1 II.  The  effect  of  range  followed  the  expected  pattern: 
as  range  increased  from  1500  to  4200  meters  the  detection  time  went  up  and 
the  number  of  acquisitions  decreased.  These  data  are  shown  in  Table  5-XVI. 


TABLE  5-XVI.  EFFECT  OF  POP-UP  RANGE 
(SIGNIFICANT  DIFFERENCE 
F(2,708)  =  107.54) 


Pop-Up 

Range 

Mean 

Time 

(5c) 

Median 

(X.50) 

Standard 

Deviation 

(a) 

E9 

1500m 

2.00 

5.40 

274 

2850m 

3.40 

8.69 

265 

4200m 

9.57s 

5.80 

10.54 

242 

Chi-square  (x^  =  21.78,  DF  =  2)  Significant 


There  was  an  interaction  between  pop-up  range  and  terrain 
table  configurations  and  between  pop-up  range  and  clutter.  The  inter-  ' 
action  between  table  configurations  and  range  is  discussed  in  Section 
5.5.4.  Table  5- XVII  shows  the  ANOVA  for  range  and  clutter. 


TABLE  5-XVII.  RANGE  VERSUS  CLUTTER 


Source 

Sum  of 
Squares 

Degrees  of 
Freedom 

Mean 

Square 

F  Ratio 

Pop-up  Range 

14.06947 

2 

7.03474 

79.32* 

Clutter 

5.91833 

1 

5.91833 

66.73* 

Range  x  Clutter 

0.37226 

2 

0.18613 

2.10 

Error 

68.73081 

775 

0.08868 

♦Significant  at  the  .05  level 


5.5.3  Secondary  Objective 

5. 5. 3.1  Altitude 

Pop-up  altitude  was  included  in  this  experiment  as  a  secondary 
objective.  The  ANOVA  did  not  show  altitude  to  be  a  significant  factor,  nor 
was  the  interaction  of  altitude  with  the  other  factors  significant.  The 
results  for  the  three  altitudes  are  shown  in  Table  5-XVII I. 
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TABLE  5-XVIII.  ALTITUDE  EFFECTS 

(NO  SIGNIFICANT  DIFFERENCE 
F(2, 708)  =  1.50) 


Altitude 


1800  feet 
1300  feet 
800  feet 


6.84s 

6.32s 

6.63s 


Standard 

Median 

Deviation 

(X. 50) 

(5) 

2.80 

9.85 

3.20 

8.34 

3.35 

7.84 

Chi-square  (x^  =  1.15,  DF  =  2)  Not  significant 


5.5.4 
5. 5. 4.1 


Additional  Results 
Observers 


In  contrast  to  the  fixed  wing  experiments.  Observer  training 
was  significant.  The  trained  Observers  tended  to  detect  more  targets  and 
detect  them  more  quickly  than  untrained  Observers.  Trained  Observers 
made  410  correct  acquisitions,  untrained  made  371.  Mean  time  of  acquisi¬ 
tion  was  5.83  seconds  for  trained,  7.45  seconds  for  untrained.  The  median 
times  were  2.7  for  trained  and  3.8  for  untrained.  These  data  are  shown  in 
Table  5-XIX.  The  differences  are  also  related  to  clutter  and  contrast  as 
is  seen  in  Table  5-XX.  Trained  Observers  tend  to  find  more  hard  (cluttered) 
targets  and  do  it  faster. 


TABLE  5-XIX. 


OBSERVERS  EFFECTS 
(SIGNIFICANT  DIFFERENCE 
F(l,708)  =  23.53) 


Mean 

Standard 

Sample 

Time 

Median 

Deviation 

Size 

Observer 

(S) 

(X. 50) 

(5) 

(N) 

Untrained 

7.45s 

3.80 

9.56 

371 

Trained 

3.83s 

2.70 

7.82 

410 

TABLE  5-XX.  CLUTTER/ CONTRAST  EFFECTS  BY  OBSERVER  TYPE 


I  0 

L 

s;- 

L 


- 


5. 5.4. 2  Terrain  Table  Configuration  Effect 

There  was  a  significant  difference  among  table  configura¬ 
tions:  terrain  table  configurations  G  and  I  differ  significantly  from 
configurations  H  and  J.  Configurations  G  and  I  are  not  significantly 
different  from  each  other  and  H  and  J  are  not  different  from  each  other 
These  results  are  shown  in  Table  5-XXI. 


TABLE  5-XXI.  TERRAIN  TABLE  EFFECTS 

(SIGNIFICANT  DIFFERENCE 
F(3,705)  =  7.56) 


Table 

Median 
(X. 50) 

Standard 

Deviation 

(a) 

Sample 

Size 

(N) 

G 

5.87s 

2.80 

8.17 

204 

H 

7.69s 

3.50 

10.10 

185 

I 

6.07s 

2.60 

8.54 

201 

J 

6.86s 

3.80 

8.05 

— 

191 

2 

Chi-square  (x  =  12.41,  DF  ■  3)  Significant 


Untrained 

Clutter/Contrast 

Number 

Median  (X.50) 

Mean 

Time  (x) 

LL 

104 

3.1 

6.02s 

ML 

90 

4.0 

6.74s 

LH 

101 

2.9 

5.45s 

MH 

76 

7.7 

12.89s 

Trained 

Clutter/Contrast 

Number 

Median  (X.50) 

Mean 

Time  (x) 

LL 

105 

2.30 

5.13s 

ML 

105 

2.8 

5.31s 

LH 

107 

2.30 

3.63s 

MH 

93 

5.40 

9.73s 

85 


There  is  an  interaction  between  terrain  table  configuration 
and  pop-up  range  as  shown  in  Table  5-XXII.  Additional  data  is  shown  in 
Table  5-XXII1. 

TABLE  XXII.  TABLE  VERSUS  POP-UP  RANGE 


Source 

Sum  of 
Squares 

Degrees  of 
Freedom 

Mean 

Square 

F  Ratio 

Table  Configuration 

1.24415 

3 

0.41472 

4.41* 

Range 

13.16502 

2 

6.58251 

70.01* 

Table  x  Range 

1.35854 

6 

0.22642 

2.41* 

Error 

72.30213 

769 

0.09402 

*Significant  at  the  .05  level 

E  TABLE  5-XXII I.  EFFECTS  OF  TERRAIN  TABLES  AND 

POP-UP  RANGE  (IN  LOG  VALUE) 


Conf iguration 

1500m 

2850m 

4200m 

G 

B m 

0.67 

0.88 

H 

■El 

0.84 

0.93 

I 

ns 

0.67 

0.83 

J 

0.62 

0.82 

0.83 

5.6  Conclusions 

In  sub-experiment  4,  the  amount  of  missing  data  is  not  as 
great  as  in  the  previous  sub-experiments.  Therefore,  more  emphasis  can  be 
placed  on  the  results  obtained  from  the  analysis  of  variance.  The  missing 
data  did  cause  the  experiment  to  be  analyzed  as  a  completely  crossed  design 
instead  of  a  partially  nested  design.  This  tends  to  make  the  analysis  less 
sensitive  (that  is,  less  likely  to  find  significant  difference  where  they 
exist) . 

5.6.1  Primary  Objectives 

Method  of  Search 

The  method  of  search  was  a  primary  objective  for  the  entire 
experiment  IB1  of  the  SEEKVAL  program;  therefore,  in  sub¬ 
experiment  4  as  well  as  in  sub-experiment  5,  when  assigned 
to  use  one  of  the  aids  the  Observers  were  given  the  option 
of  using  either  direct  visual  (DV)  method  or  using  direct 
visual  aided  by  either  the  SO  method  or  EO  method.  Also, 
in  the  rotary  wing  experiments,  time  was  the  factor  of 
measurement,  rather  than  acquisition  ranges  used  in  the 
fixed  wing  experiments.  The  Observers  selected  the  DV 
method  to  a  much  greater  degree  in  sub-experiments  4  and 
5  than  in  the  first  three  sub-experiments.  As  noted  in 
Table  5-VIII,  the  number  of  acquisitions  achieved  by  DV 
was  five  times  greater  than  those  achieved  by  the  other 


two  methods  in  actual  search  method;  and  it  was  twice  as 
great  as  the  number  of  acquisitions  made  in  any  of  the 
three  methods  in  the  assigned  search  method.  This  occur¬ 
rence  was  particularly  evident  at  the  1500  meter  range, 
indicating  that  the  visual  aids  were  of  no  real  value  in 
short-range  target  detection  when  the  use  is  optional. 

In  fact,  it  is  shown  statistically  in  both  Tables  5-IV 
and  5-VIII  that  the  acquisition  time  was  increased  when 
the  visual  aids  were  utilized.  It  is  possible,  of  course, 
that  these  results  could  have  changed  if  the  nested  design 
of  the  tests  had  been  retained. 

2^  Pop-up  Range 

Pop-up  range  was  a  significant  factor  in  this  experiment, 
and  probably  was  the  most  dominant  factor  considered  in 
any  of  the  five  experiments  under  experiment  IB1.  Of  all 
of  the  ANOVA's  calculated,  the  pop-up  range,  where  applica¬ 
ble,  was  consistently  the  largest  contributor  to  statistical 
significance.  As  shown  in  Table  5-XVI,  the  ANOVA  developed 
a  very  significant  F  ratio,  the  mean  times  for  acquisition 
were  lower  for  1500  meters  than  for  2850  meters,  and  means 
for  2850  meters  were  lower  than  for  4200  meters  range. 

Also  the  number  of  acquisitions  increased  as  the  pop-up 
range  was  shortened.  Inasmuch  as  the  three  pop-up  ranges 
assigned  to  this  experiment  were  somewhat  less  than  the 
overall  mean  range  at  acquisition  for  the  fixed  wing  ex¬ 
periments,  this  strong  influence  of  pop-up  range  on  the 
data  analysis  could  have  been  expected.  The  primary  ob¬ 
jective  of  sub-experiment  4  with  regard  to  pop-up  range 
has  been  positively  achieved  for  the  pop-up  ranges  of 
1500,  2850,  and  4200  meters. 

3[  Clutter 

Another  primary  objective  for  this  sub-experiment  was  the 
effect  of  clutter,  which  approached  the  level  of  influence 
exerted  by  pop-up  range  in  dominance  of  analysis  data. 

Both  significantly  lower  mean  times  for  acquisition  and 
significantly  more  acquisitions  were  achieved  under  low 
clutter  conditions  than  with  high  clutter.  The  analysis 
for  interaction  of  pop-up  range  and  clutter  (Table  5-XIV) 
demonstrated  that  clutter  had  a  greater  effect  on  acquisi¬ 
tion  as  the  pop-up  range  was  increased,  indicating  that 
clutter  was  only  slightly  less  influential  than  pop-up 
range.  The  interaction  of  clutter  and  contrast  analysis 
(Table  5-IX)  showed  clutter  to  have  a  greater  effect  than 
contrast  and  the  two  way  ANOVA  (Table  5-XII)  produced  a 
significant  F  ratio  for  the  interaction,  with  clutter  con¬ 
tributing  the  greater  influence.  In  regard  to  the  primary 
objective  of  the  IB1  experiment,  comparing  direct  visual 
acquisition  with  sensor-aided  vision,  the  ANOVA  showed  the 
interaction  of  assigned  search  method  versus  clutter  was 
not  significant. 


4  Contrast 


Contrast  of  the  targets  with  respect  to  the  background 
was  also  a  primary  objective  of  sub-experiment  4,  and  the 
ANOVA  (Table  5-III)  showed  a  significant  F  ratio  for  con¬ 
trast.  However,  Table  5-XI  displays  a  shorter  mean  time 
for  acquisition  and  a  greater  number  of  acquisitions  for 
low  contrast  than  for  high  contrast  conditions.  This 
inversion  of  results  from  the  expected,  as  well  as  from 
results  of  previous  target  acquisition  studies,  would 
appear  to  indicate  that  some  other  variable  influenced 
these  acquisitions.  To  resolve  this  apparent  anomaly,  it 
would  seem  that  either  additional  controls  in  the  test 
environment  or  a  more  restrictive  definition  of  contrast 
should  be  established  in  future  testing. 

Secondary  Objective 

1  Pop-up  Altitude 

A  secondary  objective  of  sub-experiment  4  was  achieved  in 
determining  that  pop-up  altitude  had  no  significant  effect 
upon  target  acquisition  for  the  conditions  set  forth  in 
this  test.  As  a  main  effect,  pop-up  altitude  did  not 
produce  a  significant  F  ratio  (Table  5-II1) ;  mean  acquisi¬ 
tion  times  were  nearly  identical  for  the  three  altitudes 
of  800,  1300,  and  1800  feet,  and  the  number  of  acquisi¬ 
tions  achieved  for  each  were  quite  close.  Six  inter¬ 
actions  of  altitude  with  other  variables  (altitude  versus 
assigned  search  method,  altitude  versus  pop-up  range, 
altitude  versus  Observer,  altitude  versus  clutter,  altitude 
versus  table  configuration,  and  altitude  versus  contrast) 
were  also  tested  in  the  ANOVA  (Table  5-III)  and  in  none  of 
these  cases  did  the  interaction  prove  to  be  significant. 

Hypotheses  Correlations 

1  Clutter 

As  stated  in  Paragraph  5.6.1  3^  clutter  had  a  definite 
effect  upon  target  acquisition  in  the  order  of  best  to 
worst  acquisition  as  low,  medium,  and  high  clutter  were 
utilized.  The  hypothesis  was  supported. 

2_  Contrast 

High  contrast  will  produce  better  target  acquisition  than 
low  contrast.  The  results  of  sub-experiment  4  demon¬ 
strated  an  inversion  to  this  hypothesis  inasmuch  as  low 
contrast  produced  better  acquisition  than  did  high 


contrast.  (See  discussion  in  Paragraph  5.6.1  4_  above). 
This  hypothesis  was  not  supported  by  sub-experiment  4 
data. 


r 


5.6.4 


L* 


J3  Clutter/Contrast  Interaction 

The  first  portion  of  this  hypothesis  was  rendered  in¬ 
applicable  due  to  the  deletion  of  the  high  clutter  case 
from  the  experimental  design  after  the  hypotheses  were 
stated  in  the  Project  Plan  (see  discussion  in  5.4.1). 

The  second  portion  of  the  hypothesis  was  supported  by 
the  results  of  the  ANOVA  (Table  5-II1)  and  the  two-way 
ANOVA  for  clutter/contrast  (Table  5-XII) .  Also,  as 
shown  in  Table  5-XIII,  medium  clutter  required  a  much 
higher  mean  time  for  acquisition  than  did  low  clutter 
under  high  contrast  conditions.  However,  an  inversion 
was  obtained  for  low  contrast  conditions  wherein  medium 
clutter  produced  lesser  mean  times  than  did  low  clutter. 

It  is  suspected  that  this  inversion  was  the  result  of  the 
same  factors  that  caused  the  inversion  discussed  in  section 
5.6.1,  4^,  above . 

Additional  Conclusions 

1^  Observer  Effects 

The  ANOVA  for  sub-experiment  4  (Table  5-III)  showed  signi¬ 
ficant  effects  from  the  use  of  trained  Observers  versus 
untrained.  The  number  of  acquisitions  was  higher  and 
the  mean  time  for  acquisition  was  lower  for  the  skilled 
Observers  (Table  5-XIX) .  In  the  analysis  of  clutter/ 
contrast  effects  by  type  of  Observer  (Table  5-XX) ,  the 
trained  Observers  were  able  to  maintain  a  consistently 
lower  mean  time  to  acquire,  and  also  attain  a  higher  num¬ 
ber  of  acquisitions;  only  in  the  condition  of  low  clutter/ 
low  contrast  was  the  performance  difference  for  Observer 
types  neglible.  It  would  seem  (from  the  results  of  sub¬ 
experiment  4  considered  as  a  complete  entity  in  itself) 
that  trained  Observers  are  definitely  superior  to  un¬ 
trained  Observers.  However,  it  should  be  remembered  that 
these  experiments  did  not  consider  the  effects  of  inter¬ 
subject  variability  and  no  data  are  available  to  evaluate 
this  factor. 

Terrain  Table  Configuration  Effects 

Another  main  effect  brought  forth  by  the  ANOVA  (Table  5-11 I) 
was  the  influence  of  the  various  table  configurations  on 
the  test  results  of  sub-experiment  4.  Table  5-XX1  shows 
the  best  to  worst  results  were  obtained  in  respect  to 
the  order  of  table  configurations  G,  I,  J,  and  H  respectively. 
The  reasons  for  this  phenomenon  are  not  discernible  from 
the  data  at  hand,  particularly  in  view  of  the  results  from 
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a  two  way  ANOVA  conducted  to  determine  interaction  of 
table  configurations  and  pop-up  range  (shown  as  signifi¬ 
cant  by  Table  5-III).  Table  5-XXIII  displays  the 
arithmetical  means  from  the  two  way  ANOVA  (Table  5-XXII) 
with  consistency  regarding  pop-up  range  influence  (dis¬ 
cussed  in  section  5.6.1,  2).  However,  the  same  analysis 
caused  an  inversion  of  the  best  to  worst  relationship 
among  the  four  table  configurations  used. 


6.0 


SUB-EXPERIMENT  5 


6.1  Objectives 

As  stated  in  the  IB1  Project  Plan  the  primary  objectives  were 

to  determine  target  acquisition  performance  as  a  function  of: 

1^  Method  of  search 

2_  Target  and  background  coloration. 

Secondary  objectives  were  determination  of  target  acquisition 
performance  as  a  function  of: 

1  Target  area  clutter 

1_  Pop-up  range  to  target. 

6.2  Experimental  Design 

The  experiment  examined  in  detail  the  performance  of  three 
search  methods  under  four  different  coloration  conditions  of  varying  clutter 
combinations  and  two  different  altitude/range  combinations.  The  three 
search  methods  were: 

1^  Direct  visual  search  without  search  aids 

2_  Direct  visual  search  in  parallel  with  search  using  a  tele¬ 
vision  sensor  using  a  variable  FOV  (2  to  8  degrees  zoom) (VF) 

3^  Direct  visual  search  in  parallel  with  search  using  a  simu¬ 
lated  stabilized  magnifying  optical  device. 

Four  Observers,  two  trained  and  two  untrained,  ran  identical  run  sets, 
giving  a  total  of  384  experimental  runs.  Both  groups  were  treated  as 
though  all  individuals  in  a  group  were  homogeneous. 

(4  table  configurations)  x  (3  search  modes)  x 
(4  clutter/coloration  conditions)  x  (2  range/ 
altitude  combinations)  x  (4  Observers  running 
identical  runs)  =  384  experimental  runs. 

Figure  6-1  illustrates  the  design  of  sub-experiment  5. 


FACTORS  CONSIDERED 

METHOD  OF  SEARCH  -  3  TYPES 
TARGET  AND  BACKGROUND  -  4  LEVELS 
POP-UP  RANGE  -  2  LEVELS 
CLUTTER  -  3  LEVELS  -  UNVARIED 

OBSERVERS  REQUIRED 

18  FOR  EACH  OF  4  CONFIGURATIONS  OF  TERRAIN 
TABLE 

MEASURES  OF  EFFECTIVENESS 
MEAN  TIME  TO  ACQUISITION 
PERCENT  OF  TARGETS  NOT  ACQUIRED 
NUMBER  OF  FALSE  ACQUISITIONS 

NUMBER  OF  TARGETS 
3  PER  AREA 

NUMBER  OF  EXPERIMENTAL  RUNS 

(24  CELLS)  x  (4  TABLE  CONFIGURATIONS)  x 
(4  OBSERVERS  RUNNING  IDENTICAL  RUNS)  =  384 

Figure  6-1.  Design  of  Sub-experiment  5 
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6.3 


Hypotheses 


Prior  to  the  experiments,  the  following  hypotheses  relative 
to  sub-experiment  5  were  postulated  (reference  Project  Plan  IB1  of  October 
1974,  Annex  K,  section  3). 

1^  Clutter  will  affect  target  acquisition  in  the  order  of  best 
acquisition  to  worst  as  low,  medium,  and  high 

2^  Clutter  will  interact  with  contrast  such  that  medium  and 
high  clutter  conditions  will  differentially  degrade  target 
acquisition;  at  equivalent  levels  of  contrast  target  acqui¬ 
sition  will  be  lower  with  clutter 

3^  At  equivalent  contrast  levels,  background  coloration  will 
not  cause  significant  differences  in  target  acquisition 
of  OD  painted  tanks 

Camouflaged  (pattern  painted)  tanks  will  take  longer  to 
find  than  OD  painted  tanks 

_5  At  equivalent  contrast  levels,  background  coloration  will 
not  significantly  affect  target  acquisition  of  camouflaged 
tanks 

j>  Clutter  will  differentially  affect  target  acquisition  of 
camouflaged  tanks. 

6.4  Method  of  Accomplishment 

6.4.1  General  Description 

Each  of  the  three  search  methods  was  used  by  different  Observers 
against  targets  positioned  on  the  terrain  table. 

The  habitat  was  brought  to  the  simulated  altitude  of  800  feet 
and  fixed  in  position.  The  run  was  started  by  the  Experimenter  at  which 
time  the  curtain  was  raised  and  the  terrain  remained  at  a  fixed  range  (1500m 
or  4200m).  The  Observer  searched  until  he  found  the  targets  or  for  a  maxi¬ 
mum  of  one  minute  as  in  sub -experiment  4.  Each  Observer  made  four  separate 
runs.  Each  of  the  four  runs  posed  a  different  situation  of  clutter/ 
coloration  while  the  illumination  and  contrast  were  maintained  constant. 

The  instant  that  the  Observer  signaled  acquisition,  a  curtain 
came  down  in  front  of  him  and  the  elapsed  time  for  the  acquisition  was  re¬ 
corded.  The  terrain  and  habitat  were  repositioned  for  the  next  run.  The 
run  was  stopped  by  the  Analog  Computer  Operator  after  one  minute  if  the 
Observer  failed  to  acquire  the  targets. 


At  the  end  of  each  of  the  four  runs,  the  Experimenter  asked 
the  Observer  questions  about  the  target  (location,  number,  colors,  and 
direction)  to  verify  correct  acquisition.  This  information  was  recorded 
on  the  Experimenter  Check  Sheet  and  also  entered  into  the  computer  through 
the  use  of  the  keyboard.  Then  the  next  run  began. 

6.4.2  Observers 

Observer  selection  for  sub-experiment  5  consisted  of: 

48  Martin  Marietta 
33  Army 
15  Marines 
96 

The  runs  were  made  from  27  February  1975  to  6  March  1975. 

6.4.3  Terrain  Table  Layout 

Sub-experiment  5  used  terrain  table  configurations  K,  L,  M, 
and  N.  Each  configuration  was  divided  into  four  separate  target  zones. 
Each  area  represented  a  different  combination  of  clutter /coloration. 

Clutter  was  classified  as  either  low,  medium,  or  high.  The 
levels  of  clutter  were  defined  in  terms  of  the  number  of  target-like  ob¬ 
jects  in  the  immediate  vicinity  of  the  target  —  low  clutter  was  repre¬ 
sented  by  no  trees  in  a  200  meter  radius  circle  about  the  target;  medium 
by  20  trees;  and  high  by  60  trees.  Table  6-1  shows  the  rotation  pattern 
of  color-clutter  through  the  four  table  configurations. 


TABLE  6-1.  CLUTTER-COLORATION/BACKGROUND 
COMPOSITION  OF  CONFIGURATIONS  K  THROUGH  N 


Target 

Zone 

K 

L 

M 

N 

I 

M-OD/BR 

M-PT/BR 

M-PT/GR 

M-OD/GR 

II 

H-OD/GR 

H-PT/GR 

H-PT/BR 

H-OD/BR 

III 

L-PT/BR 

L-OD/BR 

L-OD/GR 

L-PT/GR 

IV 

M-PT/GR 

M-OD/GR 

M-OD/BR 

M-PT/BR 

B 


- 


I 


■j) 


The  contrast  of  the  individual  targets  with  respect  to  their 
backgrounds  was  maintained  constant  at  approximately  0.50  negative  contrast 
ratio.  This  was  achieved  by  using  colors  for  the  tanks  of  approximately  the 
same  luminance,  and  by  closely  controlling  the  luminance  of  the  backgrounds. 
Contrast  was  defined  as  the  difference  between  the  luminance  of  the  target 
and  background  divided  by  the  luminance  of  the  background,  i.e.,  C  =  (Lj  - 
Lfi) /Lg ■  The  different  backgrounds  were  either  brown  (BR)  or  green  (GR) . 

The  tank  colorations  were  olive  drab  (0D)  and  pattern  painted  camouflage 
(PT) .  Actual  contrasts  are  shown  in  Table  6-II.  These  figures  are  the 
average  contrasts  of  the  three  target  tanks  in  each  zone  with  respect  to 
the  background. 

TABLE  6-II.  NEGATIVE  CONTRAST  RATIO  OF  THE 
TARGETS  FOR  CONFIGURATIONS  K  THROUGH  N 


Target 

Zone 

K 

L 

M 

N 

I 

0.52 

0.56 

0.54 

0.51 

II 

0.50 

0.53 

0.48 

0.50 

III 

0.54 

0.56 

0.47 

0.51 

IV 

0.57 

0.52 

0.51 

0.52 

6.4.4 


Illumination  Condition 


Overhead  fluorescent  lighting  was  used  to  achieve  overcast  con¬ 
ditions  for  all  runs  in  sub-experiment  5. 


6.4.5 


Measures  Used 


For  each  individual  run,  the  time  of  acquisition  was  recorded; 
valid  as  well  as  false  acquisitions  and  failures  to  acquire  targets  were 
also  recorded. 


6.5 


Results 


Two  working  procedures  were  used  in  the  analyses  of  the  data 
from  sub-experiment  5: 

_1  Any  correct  acquisition  made  at  the  proper  location  was 

considered  as  valid,  regardless  of  how  many  tanks  were  re¬ 
ported  at  that  location.  Thus,  when  an  Observer  reported 
one,  two,  three,  or  more  tanks  at  a  proper  location  this 
was  considered  as  a  valid  target  acquisition.  Only  valid 
acquisitions  are  considered  in  the  statistical  computations 


2_  All  data  reporting  mean  range  and  the  standard  deviations 
thereof  are  based  upon  the  number  of  acquisitions  made, 
and  do  not  include  unsuccessful  acquisition  attempts. 

Factors  in  this  experiment  were  method  of  search,  clutter, 
range,  Observer  training,  target  coloration,  and  background  coloration.  As 
in  sub-experiment  4  the  observed  response  was  detection  time  in  seconds. 
Also  the  logarithmic  transformation  was  applied  to  the  data  prior  to  analy¬ 
sis.  In  this  experiment  322  of  384  (84  percent)  acquisition  attempts  were 
successful. 

6.5.1  Analysis  of  Variance 

The  ANOVA  is  shown  in  Table  6-11 I.  Main  effects,  two-way  in¬ 
teractions,  and  three-way  interactions  were  included  in  the  model.  At  the 
.05  level  of  significance,  the  main  effects  of  method  of  search,  range.  Ob¬ 
server  training,  and  clutter  were  significant.  The  two-way  interactions  of 
pop-up  range  versus  clutter  and  clutter  versus  background  coloration  and 
the  three-way  interaction  of  assigned  search  method  versus  Observer  skill 
versus  target  coloration  were  significant. 

6.5.2  Primary  Objectives 

6. 5. 2.1  Search  Method 

Three  methods  of  search  were  available,  unaided  direct  view 
(DV) ,  stabilized  optic  (SO)  aid,  and  an  electro-optical  television  (E/0) 
aid.  In  all  cases  where  an  aid  was  assigned,  the  Observer  could  (and  usu¬ 
ally  did)  use  direct  vision  with  the  aid  as  an  alternative.  Results  are 
presented  as  a  function  of  both  the  assigned  search  method  and  the  actual 
search  method.  It  is  evident  that  the  actual  search  method  used  made  a 
significant  difference  in  number  of  targets  acquired.  The  use  of  the  aid 
did,  in  fact,  increase  the  time  of  acquisition.  The  data  indicate  that 
the  majority  of  the  Observers  did  not  use  the  aid  except  at  the  4200  meter 
range. 

6. 5. 2. 1.1  Assigned  Search  Method 

As  in  sub-experiment  4,  the  assigned  search  method  was  a  sig¬ 
nificant  factor.  The  DV  mode  resulted  in  the  quickest  detection  time  and 
the  E/0  mode  the  longest.  There  is  significant  difference  in  the  number  of 

acquisitions  by  search  mode.  Table  6-IV  shows  the  results  for  the  assigned 

search  modes. 

6. 5. 2. 1.2  Actual  Search  Method 

The  actual  search  method  resulted  in  significant  differences 
for  both  detection  time  and  number  of  detections.  As  in  sub-experiment  4, 
there  was  an  overwhelming  tendency  to  disregard  the  aid  and  go  to  the  di¬ 
rect  visual  mode.  Approximately  75  percent  of  the  Observers  used  the  DV 
mode.  Results  of  the  actual  search  method  used  are  shown  in  Table  6-V. 


TABLE  6 '■III.  SUB-EXPERIMENT  5  ANOVA 


Source 

Sum 

of 

Squares 

Degrees 

of 

Freedom 

Mean  Square 

F  Ratio 

Assigned  Search  Method 

0.91341 

2 

t  7-5671 

6.05703* 

Range 

10.16557 

1 

10.16557 

134.81978* 

Observer 

1.34471 

1 

1.34471 

17.83406* 

Clutter 

12.37853 

2 

6.18927 

82.08446* 

Target 

0.06633 

1 

0.06633 

0.87975 

Background  Color 

0.01630 

1 

0.01630 

0.21622 

Assigned  Search  Method/Range 

0.01606 

2 

0.00803 

0.10648 

Assigned  Search  Method /Observer 

0.35399 

2 

0.17700 

2.34741 

Assigned  Search  Method/Clutter 

0.72506 

4 

0.18127 

2.40402 

Assigned  Search  Method/Target 
Color 

0.21824 

2 

0.10912 

1.44718 

Assigned  Search  Method/ 
Background  Color 

0.07331 

2 

0.03665 

0.48611 

Rang  e/Observer 

0.00533 

1 

0.00533 

0.07Q74 

Range/Clutter 

2.08065 

2 

1.04033 

13.79720* 

Range/Target  Color 

0.01902 

1 

0.01902 

0.25229 

Range/Background  Color 

0.00640 

1 

0.00640 

0.08491 

Observer /Clutter 

0.04503 

2 

0.02251 

0.29859 

Observer/Target  Color 

0.00003 

1 

0.00003 

0.00043 

Observer /Background  Color 

0.05604 

1 

0.05604 

0.74327 

Clutter/Target  Color 

0.21480 

2 

0.10740 

1.42438 

Clutter/Background  Color 

0.48375 

2 

0.24188 

3.20786* 

Target  Color/Background  Color 

0.06895 

1 

0.06895 

0.91466 

Assigned  Search  Method/Range/ 
Observer 

0.42342 

2 

0.21421 

2.84093 

Assigned  Search  Method/Range/ 
Clutter 

0.22136 

4 

0.05534 

0.73395 

Assigned  Search  Method/Range/ 
Target 

0.03226 

2 

0.01613 

0.21394 

Assigned  Search  Method/Range/ 
Color 

0.14383 

2 

0.07191 

0.95375 
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TABLE  6-III.  SUB-EXPERIMENT  5  ANOVA  (Cont) 


Sum 

of 

Source 

Squares 

Assigned  Search  Method/  0.18422 

Observer /Clutter 

Assigned  Search  Method/  0.46918 

Observer/Target  Color 

Assigned  Search  Method/  0.12012 

Observer/ Background  Color 

Assigned  Search  Method/Clutter/  0.04828 

Target  Color 

Assigned  Search  Method/Clutter/  0.28166 

Background  Color 

Assigned  Search  Method/  0.04574 

Background  Color/ Background  Color 

Assigned  Search  Method/  0.37671 

Observer /Clutter 

Range/Observer/Target  Color  0.16511 

Range/Observer /Target  Color  0.16985 

Range/Clutter/Target  Color  0.05600 

Range/Clutter/Background  Color  0.10236 

Observer/Clutter/Target  Color  0.10236 

Observer /Clutter /Background  0.12247 

Color 

Clutter/Target  Color/Background  0.30887 

Color 

Error  18.47330 


*Significant  at  the  .05  level 


- 1 

Degrees 

of 

Freedom 

Mean  Square 

F  Ratio 

4 

0.04606 

0.61080 

2 

0.23459 

3.11134* 

2 

0.06006 

0.79655 

4 

0.01207 

0.16007 

4 

0.07192 

0.95378 

2 

0.02287 

0.30330 

2 

0.03836 

0.50871 

1 

0.16511 

2.18979 

1 

0.16985 

2.25261 

2 

0.02800 

0.37132 

2 

0.06118 

0.67880 

2 

0.19127 

2.53673 

2 

0.06123 

0.81209 

2 

0.15444 

2.04819 

245 

0.07540 
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TABLE  6-IV.  ASSIGNED  SEARCH  METHOD  RESULTS 
(SIGNIFICANT  DIFFERECNE 
F(2,245)  =  6.06) 


Assigned  Search 
Method 

Mean  Time 
(x) 

Median  (X.50) 

Standard 

Deviation 

(5) 

Sample 

Size 

(N) 

DV 

7.70s 

3.40 

10.42 

100 

DV  +  SO 

9.82s 

6.20 

10.18 

116 

DV  +  EO 

12.42s 

5.25 

14.31 

106 

Chi-square  (x^  =  7.54,  DF  =  2)  Significant 


TABLE  6-V.  ACTUAL  SEARCH  METHOD  USED 


Assigned  Search 
Method 

Mean  Time 
(x) 

Median  (X.50) 

Standard 

Deviation 

(5) 

Sample 

Size 

(N) 

DV 

6.22s 

3.35 

8.52 

241 

DV  +  SO 

16.19s 

14.70 

9.65 

49 

DV  +  EO 

29.16s 

27.80 

14.29 

32 

Chi-square  (x^  =  22.12,  DF  =  2)  Significant 


6. 5. 2. 2  Target  and  Background  Coloration 

Neither  target  nor  background  coloration  proved  to  be  a  signi¬ 
ficant  factor.  There  was,  however,  an  interaction  between  background  col¬ 
oration  and  clutter,  as  discussed  in  section  6. 5. 3.1.  Tables  6-VI  and  6- 
VII  show  the  results  for  coloration. 


TABLE  6-VI.  TARGET  COLORATION 

(NO  SIGNIFICANT  DIFFERENCE 
F (1, 245)  =  .88) 


Target  Coloration 

Mean  Time 
(x) 

Median  (X.50) 

Standard 

Deviation 

(o) 

Sample 

Size 

(N) 

Olive  Drab 
(OD) 

9.69s 

4.50 

11.22 

161 

Pattern  Painted 
(PT) 

10.34s 

5.30 

12.53 

161 

Chi-square  (x^  =  0.02,  DF  =  1)  Not  significant 
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TABLE  6-VII.  BACKGROUND  COLORATION 

(NO  SIGNIFICANT  DIFFERENCE 
F  (2,245)  =  .22) 


Background 

Coloration 

Mean  Time 
(x) 

Median  (X.50) 

Standard 

Deviation 

(S) 

Sample 

Size 

(N) 

Brown 

10.75s 

5.00 

12.72 

157 

Green 

9.31s 

4.50 

11.02 

165 

2 

Chi-square  (x  =  0.94,  DF  =  1)  Not  significant 


6.5.3  Secondary  Objectives 

6. 5. 3.1  Clutter 

As  in  the  other  experiments,  clutter  was  a  significant  factor. 

Increases  in  the  level  of  clutter  caused  an  increase  in  detection  time, 
although  in  this  experiment  there  was  no  significant  difference  between  the 
medium  and  high  levels  of  clutter.  Table  6-VIII  shows  the  results  for 
clutter. 


TABLE  6-VIII.  EFFECTS  OF  CLUTTER 

(SIGNIFICANT  DIFFERENT 
F(2,245)  =  82.08) 


Clutter 

Level 

Mean  Time 
(x) 

Median  (X.50) 

Standard 

Deviation 

(a) 

Sample 

Size 

(N) 

Low 

3.75s 

2.30 

4.02 

94 

Medium 

11.98s 

6.80 

12.61 

155 

High 

13.90s 

7.90 

13.90 

73 

Chi-square  (x^  =  19.74,  DF  =  2)  Significant 


There  was  an  interaction  between  clutter  and  background  col¬ 
oration  and  also  an  interaction  between  clutter  and  range.  Tables  6-IX 
and  6-X  show  the  effects  of  coloration  and  clutter  at  the  1500  meter  and 
4200  meter  range.  At  the  low  and  high  levels  of  clutter  there  was  no  dif¬ 
ference  between  the  brown  and  green  background.  However,  at  the  medium 
level  of  clutter  the  detection  time  for  green  background  is  greater  than 
for  the  brown  background. 

Table  6-XI  presents  the  total  target  acquisitions  (in  number  of 
targets)  and  detection  time  (in  seconds)  for  coloration  alone. 
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TABLE  6-XI .  EFFECTS  OF  COLORATION  ON  NUMBER  AND  TIME 
(SECONDS)  OF  TARGET  ACQUISITIONS 


Coloration 

Altitude/ Range 

800  feet/1500  meters 

800  feet/4200  meters 

Number 

Median 

(X.50) 

■ 

msm 

Number 

Median 

(X.50) 

ilfn 

OD/GR 

47 

2.9 

5.34  s 

35 

14.2 

13.45s 

0D/BR 

47 

3.4 

6.39s 

32 

12.2 

16.78s 

PT/GR 

46 

3.0 

6.22s 

37 

10.0 

14.27s 

PT/BR 

46 

3.75 

6.71s 

32 

10.35 

16.96s 

6.5. 3.2  Pop-up  Range 

The  ANOVA  showed  range  to  be  a  significant  factor  as  it  was  in 
sub-experiment  4.  At  4200  meters  the  detection  time  was  over  twice  that  at 
1500  meters.  Also  there  was  a  decrease  in  the  number  of  acquisitions  at 
4200  meters.  Table  6-XII  shows  the  results  for  the  two  ranges. 


TABLE  6-XII.  EFFECT  OF  RANGE 

(SIGNIFICANT  DIFFERENCE 
F  (1,245)  =  134.82) 


Range 

Mean 

T  ime 
(x) 

Median 

(X.50) 

Standard 

Deviation 

A 

(o) 

Sample 

Size 

(N) 

1500m 

6 . 16s 

3.20 

8  63 

186 

4200m 

15.28s 

10.95 

13.60 

136 

Chi-square  (\^  =  46.18,  DF  =  1)  Significant 


As  mentioned  in  Section  6. 5. 3.1  there  was  an  interaction  be¬ 
tween  range  and  clutter.  At  the  longer  range  the  detection  time  showed  a 
larger  increase  at  the  medium  and  high  levels  than  at  the  low  clutter  level 
Table  6-XIII  shows  the  ANOVA  for  this  interaction. 


TABLE  6-XIII .  RANGE  VERSUS  CLUTTER 


Source 

Sum  of 
Squares 

Degrees 

of 

Freedom 

Mean 

Square 

F  Ratio 

Range 

10.83103 

1 

10.83103 

130.35* 

Clutter 

12.51166 

2 

6.255A3 

75.29* 

Range  x  Clutter 

1.70514 

2 

0.85257 

10.26* 

Error 

26.25778 

316 

0.08309 

*Significant  at  the  .05  level 


6.5.4  Additional  Results 

Observer  training  was  also  significant  in  this  sub-experiment. 
The  trained  Observer  tended  to  acquire  more  targets  faster  than  the  un¬ 
trained.  Trained  Observers  made  170  correct  acquisitions,  untrained  made 
152.  The  difference  in  number  of  acquisitions  was  not  significant,  although 
differences  in  time  of  acquisition  were  significant.  Mean  time  for  trained 
was  9.25  seconds  with  a  standard  deviation  of  11.68,  for  untrained  the  mean 
time  was  10.87  seconds  with  a  standard  deviation  of  12.08.  Median  values 
were  4.4  seconds  for  trained  Observers  and  5.7  seconds  for  untrained,  as 
seen  in  Table  6-XIV.  The  homogeneity  of  the  two  groups  is  not  known. 


TABLE  6-XIV.  OBSERVERS 

(SIGNIFICANT  DIFFERENCE 
F(l,245)  =  17.83) 


Mean 

Standard 

Sample 

Time 

Median 

Deviation 

Size 

Observers 

(x) 

(X. 50) 

(5) 

(N) 

Trained 

10.87s 

5.75 

12.08 

152 

Untrained 

9.25s 

4.55 

11.68 

170 

Chi-square  (x2  =  5.56,  DF  =  1)  Significant 


6.6  Conclusions 

6.6.1  Primary  Objective 

6.6. 1.1  Method  of  Search 

As  found  in  sub-experiment  4,  the  effect  of  search  method  in 
sub-experiment  5  was  emphatic  for  the  samples  tested.  The  ANOVA  (Table 
6-III)  found  significance  in  the  assigned  search  method  when  examined  with 
respect  to  the  time  of  acquisition,  and  further  examination  (Table  b-IV) 
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showed  assigned  search  method  significant.  When  actual  search  method  used 
was  addressed,  significance  was  found  in  both  time  and  numbers  (Table  6-V) . 
Both  treatments  showed  DV  was  most  effective  in  terms  of  search  time  fol¬ 
lowed  by  SO  and  EO,  in  that  order.  The  increase  in  the  DV  sample  size 
resulting  from  the  actual  use  treatment  shows  nearly  three  times  as  many 
acquisitions  in  that  mode.  Not  only  did  the  Observers  prefer  direct  view, 
it  was  the  most  effective  overall.  Again,  as  in  sub-experiment  4,  the  ranges 
used  in  the  experiment  are  concluded  to  be  rather  short  to  provide  an  effect¬ 
ive  evaluation  of  the  aided  search  methods  selected.  However  the  objective 
was  served  in  that  the  relative  utility  of  the  three  search  methods  was 
demonstrated  for  ranges  of  1500  and  4200  meters.  As  stated  before,  however, 
the  truncation  of  data  cells  could  negate  the  validity  of  the  samples  as 
being  representative  of  the  population. 

6. 6. 1.2  Target  and  Background  Coloration 

These  factors  were  shown  not  significant  (See  Tables  6-III, 

6-VI,  and  6-VII)  although  an  interaction  did  develop  between  background 
coloration  and  clutter.  This  objective  of  the  sub-experiment  was  met. 

6.6.2  Secondary  Objectives 

6. 6. 2.1  Clutter 

This  factor  was  again  shown  to  be  significant  (see  Tables  6-III 
and  6-VI1I).  Clutter  behaved  as  expected  in  that  detection  time  varies 
directly  with  clutter  level.  Further,  clutter  showed  interaction  with  back¬ 
ground  coloration  and  range.  The  medium  level  of  clutter  produced  consistenly 
different  acquisition  times  for  green  and  brown  backgrounds;  the  other  two 
levels  showed  no  consistent  pattern  differential  (Table  6-XI).  When  clutter 
is  a  constant,  search  time  increases  with  range,  but  differentially  for  low 
clutter  and  medium/high  clutter  (Tables  6-IX  and  X).  The  data  do  not  appear 
to  offer  an  easy  explanation  for  the  interaction,  but  the  clutter-related 
objective  was  met  in  that  once  again  clutter  demonstrated  a  major  influence 
on  target  acquisition  within  the  actual  test  parameters  examined. 

6. 6. 2. 2  Pop-up  Range 

The  ANOVA  (Table  6-III)  and  the  analysis  presented  in  Table 
6-XII  clearly  demonstrated  range  to  be  a  dominant  factor  in  this  sub-ex¬ 
periment.  It  is  concluded  that  the  experimental  designs  met  this  objective 
and  that  pop-up  range  behaves  in  the  expected  manner. 

6.6.3  Hypothesis  Correlations 

6. 6. 3.1  Clutter 

The  hypothesis  that  clutter  will  affect  target  acquisition  in 
the  order  of  best  acquisition  to  worst  as  low,  medium,  and  high  was  supported 
by  this  sub-experiment.  As  noted  in  5, 6. 2.1,  clutter  was  significant  and 
affected  target  acquisition  as  predicted. 
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6. 6. 3. 2 


Background  Color 


The  hypothesis  that,  at  equivalent  contrast  levels  background 
color  will  not  cause  significant  differences  in  target  acquisition  of  OD  or 
pattern  painted  tanks,  was  supported  by  this  sub-experiment.  The  experi¬ 
ment  demonstrated  no  significant  effects  due  to  target  and  background  col¬ 
oration  . 

6. 6. 3. 3  Camouflage 

The  hypothesis  that  camouflaged  (pattern  painted)  tanks  will 
take  longer  to  find  than  OD  painted  tanks  was  not  supported  by  this  sub¬ 
experiment.  A  slight  difference  in  the  hypothesized  direction  was  found 
as  shown  in  Table  6-VI,  but  the  differential  fails  to  be  significant  by  a 
wide  margin  (Table  6-III). 

6. 6. 3. 4  Clutter /Camouflage 

The  hypothesis  that  clutter  will  differentially  affect  target 
acquisition  of  camouflaged  and  OD  tanks  was  not  supported.  No  interaction 
of  clutter  and  target  coloration  was  found. 

6.6.4  Additional  Results 

The  trained  Observers  demonstrated  a  significant  superiority 
over  untrained  Observers  in  terms  of  time  of  acquisition.  This  result  is 
consistent  with  the  results  of  the  other  rotary  wing  sub-experiment. 

No  data  were  obtained  regarding  intersubject  variability. 
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SUMMARY  EFFECTS  OF  CONTROLLED  EXPERIMENTAL  VARIABLES 


This  section  presents  the  results  of  the  five  sub-experiments 
of  the  IB1  experiment.  Specifically,  the  relative  effect  of  the  experimental 
factors  on  target  acquisition  probability  and  range  are  examined.  There 
were  nine  experimental  factors  -  eight  of  these  were  explicit,  being  either 
primary  or  secondary  in  one  or  more  of  the  sub-experiments,  while  one. 
Observer  training,  was  implicit  in  the  experimental  design  in  that  every 
cell  contained  a  balanced  sample  of  trained  and  untrained  Observers .  Caution 
should  be  exercised  in  accepting  these  results  as  bein^  definitive  because 
the  observers'  option  in  visual  aid  use  in  effect  caused  the  nested  design 
of  the  tests  to  become  a  cross  design.  Also,  target  arrays  could  have 
provided  each  observer  with  some  cue  to  location  in  his  second  run.  This 
second  possibility  was  accepted  because  the  use  of  another  arrav  would 
have  introduced  another  variable  to  the  experiments.  Table  7-1  presents 
a  summary  of  the  relative  influence  of  each  factor  in  each  of  the  actual 
experiments  as  they  developed  under  the  optional  use  of  the  aids. 

TABLE  7-1.  RELATIVE  INFLUENCE  OF  EXPERIMENTAL  FACTORS 


Sub-experiment 

Factors 

1 

2 

3 

4 

5 

Method  of 
Search 

Significant 

Minor 

Significant 

Major 

Major 

Clutter 

Major 

Significant 

Significant 

Major 

Major 

Contrast 

Minor 

Minor 

Minor 

Significant 

No  Factor 

Illumination 

Angle 

Minor 

No  Factor 

Minor 

No  Factor 

No  Factor 

Number  of 
Targets 

No  Factor 

Significant 
(Range  only) 

No  Factor 

No  Factor 

No  Factor 

Pop-up  Range 

No  Factor 

No  Factor 

No  Factor 

Major 

Major 

Pop-up 

Altitude 

No  Factor 

No  Factor 

No  Factor 

Minor 

No  Factor 

Coloration 

No  Factor 

No  Factor 

No  Factor 

No  Factor 

Minor 

Observer 

Training 

Minor 

Minor 

Minor 

Significant 

Significant 

Definitions: 

Major  =  Statistically  signifi¬ 

cant  and  exerted 
powerful  influence 
on  the  results. 

Significant  =  Statistically  signifi¬ 
cant  but  not  over¬ 
powering  . 


Minor  =  Not  statistically  sig¬ 
nificant,  but  some 
influence  or  conflict 
ing  trends  noted. 

No  Factor  =  Not  a  factor  in  the 
experiment . 


The  paragraphs  that  follow  address  the  effects  of  each  of  the 
nine  experimental  factors  individually. 
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Method  of  Search 


This  variable  was  the  second  most  influential  in  the  overall 
IBl  experiment,  being  surpassed  only  by  clutter.  Unlike  clutter,  search 
method  did  not  display  a  consistent  direction  of  influence.  In  the  fixed 
wing  experiments,  the  use  of  the  three  aided  modes  either  improved,  or  at 
least  did  not  adversely  influence,  target  acquisition  range  when  compared 
to  direct  view.  In  the  rotary  wing  experiments,  however,  the  aids  uni¬ 
versally  degraded  target  acquisition  times  by  a  large  margin  although  a 
possible  error  of  interpopulation  could  have  been  introduced.  Tables 
7-II  and  7-III  illustrate  these  points. 

TABLE  7-II .  FIXED  WING  SEARCH  METHOD  COMPARISONS 


Search 

Me  thod 

Mean  Acquisition 

Ranges  (Meters) 

Sub- 

Experiment  1 

Sub- 

Experiment  2 

Sub- 

Experiment  3 

Overall 
Fixed  Wing 

DV 

4401 

4391 

5521 

4768 

DV  + 

NF 

4559 

4606 

5282 

4752 

DV  + 

WF 

5189 

4366 

5429 

5154 

DV  + 

VF 

4942 

5039 

5049 

4977 

TABLE  7-III .  ROTARY  WING  SEARCH  METHOD  COMPARISONS 


Mean  Acquisition  Times  (Seconds) 


Search  Method  Sub-Experiment  4 


4.49 

22.29 

14.37 


Sub-Experiment  5 


6.22 

29.16 

16.19 


Overall 
Rotary  Wing 


4.95 

24.76 

15.16 


When  numbers  of  acquisition  are  considered,  the  direct  visual 
mode  clearly  dominates  (Table  7-IV) ;  however,  this  cannot  be  used  to  infer 
that  the  use  of  the  aids  lowered  the  probability  of  acquisition.  Since 
many  Observers  assigned  aids  elected  not  to  use  them,  the  sample  sizes  for 
the  various  search  methods  was  grossly  unbalanced. 

In  terms  of  mean  acquisition  ranges,  the  wide  field  of  view 
was  the  most  successful  of  the  aids  in  the  fixed  wing  experiments,  followed 
closely  by  the  variable  field.  In  the  rotary  wing  experiments,  the  sta¬ 
bilized  optics  were  markedly  superior  to  the  electro/optical  aid,  although 
again  the  truncated  nature  of  the  data  causes  the  validity  to  be  inconclu¬ 
sive  . 
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TABLE  7-IV.  TARGET  ACQUISITION  TOTALS  BY  SEARCH  METHOD 


Search  Method 

Numbers  of  Targets  Acquired 

Sub- 

Experiment 

1 

Sub- 

Experiment 

2 

Sub- 

Experiment 

3 

Sub- 

Experiment 

4 

Sub- 

Experiment 

5 

DV 

130 

29 

78 

660 

241 

DV  +  NF 

55 

11 

23 

DV  +  WF 

56 

13 

30 

DV  +  VF* 

66 

9 

24 

57 

32 

DV  +  SO 

64 

49 

*Variable  Field  in  fixed  wing  and  electro-optical  in  rotary  wing  used 
the  same  device  except  for  the  initial  aiming  system. 


When  viewed  in  terms  of  cumulative  probability  of  detection, 
as  seen  in  Figure  7-1,  the  wide  field  of  view  provided  the  highest  cumula¬ 
tive  probability  of  acquisition  of  the  three  aids.  It  was,  however,  in¬ 
ferior  to  the  other  two  beyond  about  5500  meters  range,  probably  because 
the  visual  angle  subtended  by  targets  beyond  this  range  was  too  small  in 
the  wide  (8  degree)  field  of  view.  The  probability  of  acquisition  curves 
derived  from  the  rotary  wing  sub-experiments  clearly  support  the  superiority 
of  the  stabilized  optics  (Figure  7-2).  Here  again,  the  possible  error  of 
interpopulation  might  have  influenced  the  results. 
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Figure  7-2.  Effect  of  Aided  Search  Method,  Rotary  Wing 


7.2  Clutter 

Clutter  was  the  most  influential  variable  in  the  overall  IB1 
experiment,  having  either  major  or  significant  influence  in  all  the  sub¬ 
experiments,  as  shown  in  Table  7-1. 


Clutter  significantly  reduced  the  probability  of  target 
acquisition  in  both  the  fixed  and  rotary  wing  experiments.  Figure  7-3 
shows  the  cumulative  probability  of  acquisition  recorded  in  sub-experiments 
1,  2,  and  3  as  a  function  of  clutter  condition  (low  =  no,  medium  =  20,  and 
high  =  60  clutter  items  in  the  immediate  target  area).  Figure  7-4  shows 
probability  of  acquisition  as  a  function  of  clutter  for  the  helicopter 
experiments . 


7.3 


Contrast 


Contrast,  as  an  independent  variable,  only  had  a  minor  effect 
on  the  experimental  results  of  three  of  the  four  sub-experiments  and  was 
significant  only  in  sub -experiment  4.  On  the  other  hand,  contrast,  as  is 
evident  in  Figure  7-5,  interacted  strongly  with  clutter.  Where  clutter 
was  not  present,  however,  high  contrast  targets  were  found  at  slightly 
|  longer  ranges  with  a  higher  probability  of  acquisition  than  low  contrast 

targets  in  the  fixed  wing  sub-experiments.  In  all  fixed-wing  sub-experiments 
combined,  the  mean  range  of  acquisition  in  low  clutter  was  5099  meters  for 
high  contrast  targets,  and  4974  meters  for  low  contrast.  In  sub-experiment 
4,  however,  mean  acquisition  time  at  low  clutter  was  5.97  seconds  for  high 
contrast  targets  and  5.57  seconds  for  low  contrast  targets.  Thus,  the 
4  contrast  effect  was  equivocal  in  the  low  clutter  case. 


CL  U/  CON 


Figure  7-5.  Interaction  Effects  of  Clutter/Contrast, 

Fixed  Wing 
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When  clutter  was  present,  contrast  appeared  to  produce  a  re¬ 
verse  effect.  As  shown  in  Figure  7-5,  low  contrast  targets  were  found  at 
longer  ranges  than  high  contrast  targets  under  both  medium  and  high  clutter 
conditions.  This  result  was  unexpected.  However,  there  are  two  likely 
explanations.  First,  the  result  may  be  an  effect  of  target-to-clutter 
contrast.  Contrast  as  an  experimental  variable,  was  measured  directly 
comparing  targets  to  their  immediate  surroundings.  In  the  experiments 
where  contrast  was  varied,  the  background  was  essentially  a  light  green, 
simulating  meadow  or  prairie.  High  contrast  tanks  were  painted  military 
OD  with  a  green  hue  added  to  obtain  an  approximate  target  to  background 
contrast  ratio  of  -0.60.  The  result  was  a  relatively  dark  green  target 
on  a  lighter  green  background.  Low  contrast  tanks  were  painted  with  beige 
to  achieve  an  approximate  target  to  background  contrast  ratio  of  -0.40. 

The  result  was  a  sandy  (or  beige)  tone  on  a  light  green  background.  Clutter 
was  then  applied  by  placing  trees  and  bushes  randomly  around  the  targets. 
When  measured,  the  contrast  ratio  of  the  clutter  items  to  the  background  was 
approximately  the  same  as  with  high  contrast  targets,  i.e.,  -0.60.  Since 
the  low  contrast  tanks  were  distinguishable  from  the  surrounding  higher 
contrast  clutter  elements  by  both  their  color  and  contrast  with  respect  to 
the  background,  they  were  possibly  easier  to  detect  than  the  high  contrast 
tanks  which  were  more  nearly  like  the  clutter  in  both  color  and  contrast. 

The  failure  to  consider  color  and  contrast  in  selection  of  the  clutter 
elements  may  have  weakened  this  phase  of  the  experiments. 

A  second  possible  explanation  may  be  the  effect  of  texture 
differences.  The  tank  targets  had  flat  surfaces  and  obvious  smooth  planes. 
The  clutter  items  were  rough  textured  trees  and  bushes.  The  small  color 
and  brightness  differences  between  tank  and  clutter  in  the  low  contrast 
situations  thus  could  have  accentuated  texture  differences. 

7.4  Illumination  Angle 

This  factor,  which  was  a  variable  in  only  two  of  the  sub¬ 
experiments,  proved  to  have  only  a  minor  influence. 

Two  results  are  evident  from  the  data  on  illumination  effects. 
First,  rate  of  acquisition  is  slightly  better  at  40  degrees  sun  elevation 
than  at  20  degrees  (48.3  percent  versus  32.3  percent,  as  seen  in  Figure 
7-6).  Second,  as  sun  azimuth  changes  from  0  to  180  degrees*,  the  rate  of 
acquisition,  too,  decreases.  Further,  the  variability  of  acquisition  in¬ 
creases  with  increasing  sun  azimuth.  Table  7-V  presents  the  combined  data 
from  sub-experiments  1  and  3. 


*Sun  azimuths  in  the  SEEKVAL  convention  are  given  such  that  at  0  degree  the 
Observer  is  looking  down  sun  (target  front  lighted)  and  at  180  degrees  the 
Observer  is  looking  into  the  sun  (target  back  lighted). 
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Figure  7-6.  Effect  of  Sun  Elevation  Angle  on  Probability 
of  Target  Acquisition 


Figures  7-7,  7-8,  7-9,  and  7-10  compare  the  probability  of 
acquisition  at  20  and  40  degrees  sun  elevations  for  the  45,  90,  135,  and 
180  degree  azimuth  conditions.  Where  appropriate,  data  from  all  terrain 
table  configurations  used  in  sub-experiment  1  are  included  for  the  40 
degrees  sun  elevation.  As  noted  in  section  2.5,  the  differences  are  not 
significant.  The  trends  evidence  a  small  tendency  for  better  acquisition 
at  40  degrees  sun  elevation  than  at  20  degrees. 
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TABLE  7-V.  EFFECTS  OF  ILLUMINATION  COMBINED  DATA 
FOR  EXPERIMENTS  1  AND  3 


Sun 

Azimuth 

(degrees) 

Mean 

Acquisition 

Range 

Standard 

Deviation 

Co¬ 

efficient* 

Variation 

Number  of 
Acquisitions 

Number 

of 

Attempts 

Probability 

of 

Acquisition 

Sun  Elevation  - 

20  degrees 

45 

5830m 

1796 

0.308 

24 

48 

0.50 

90 

4298m 

1878 

0.437 

15 

45 

0.33 

135 

6047m 

2445 

0.404 

12 

48 

0.25 

180 

4975m 

2412 

0.485 

_ 

10 

48 

0.20 

Sun  Elevation  - 

40  degrees 

0 

5669m 

1119 

26 

48 

45 

5623m 

1379 

22 

48 

90 

4879m 

1936 

0.397 

133 

287 

135 

4274m 

1751 

89 

288 

180 

4821m 

2296 

97 

288 

Overcast 

Sky 

1 

1 

1 

4546m 

1902 

_ 

0.418 

120 

286 

0.42 

*Coefficient  of  variation  =  standard  deviation  divided  by  the  mean 


Figure  7-7.  Effect  of  Sun  Angle,  45  Degrees  Azimuth 


CUMULATIVE  PROBABILITY  CUMULATIVE  PROBABILITY 

TARGET  ACQUISITION  TARGET  ACQUISITION 


RANGE  -  M 

Figure  7-8.  Effect  of  Sun  Angle,  90  Degrees  Azimuth 


Figure  7-9.  Effect  of  Sun  Angle,  135  Degrees  Azimuth 
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Figure  7-10.  Effect  of  Sun  Angle,  180  Degrees  Azimuth 


The  SEEKVAL  IA1  Experiment  likewise  reported  no  significant 
difference  in  target  acquisition  performance  at  0,  90,  and  180  degrees  sun 
azimuths  in  a  terrain  table  experiment. 

It  is  noted  that  the  data  for  overcast  sky  are  representative 
of  general  illumination  conditions.  The  mean  range,  standard  deviation, 
coefficient  of  variation  and  percentage  targets  acquired  are  all  at  the 
approximate  mid-point  of  values  for  the  illumination  conditions  tested,  as 
seen  in  Table  7-V.  This  implies  that  use  of  "overcast  sky"  in  the  other 
experiments  was  a  reasonable  choice,  which  neither  conflicted  with  nor 
degraded  the  results. 


7.5  Number  of  Targets 

Sub-experiment  2,  the  only  one  in  which  the  number  of  targets 
was  a  factor,  showed  that  this  factor  had  a  significant  impact  on  target 
acquisition  performance.  Because  this  was  a  smaller  test  than  the  others, 
the  truncated  data  may  have  caused  an  even  greater  possibility  of  the 
results  not  being  representative  of  the  entire  population.  Observers 
acquired  target  arrays  of  one,  three,  and  nine  tanks  in  ascending  order  of 
effectiveness.  It  is  interesting  to  note,  however,  that  only  one  Observer 
correctly  reported  nine  tanks  in  an  array.  Most  Observers,  confronted  with 
this  array  reported  3  to  5.  Thus,  although  the  nine  tank  arrays  were  most 
easily  acquired,  the  true  strength  of  the  formation  did  not  become  apparent 


ft 
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7.6 


Pop-up  Range 


The  two  helicopter  sub-experiments  (4  and  5)  in  which  this 
variable  was  present  showed  range  to  have  major  influence  over  the  target 
acquisition  process.  Figure  7-11  shows  the  cumulative  probability  of  de¬ 
tection  as  a  function  of  range  for  sub-experiments  4  and  5  combined.  The 
effect  is  as  expected  and  quite  pronounced. 


Figure  7-11.  Effect  of  Pop-Up  Range,  Rotary  Wing 


7.7  Pop-up  Altitude 

Altitude,  a  variable  only  in  sub-experiment  4,  proved  to  have 
only  minor  effect  on  target  acquisition.  Figure  7-12  displays  the  cumula¬ 
tive  probability  of  detection  as  a  function  of  this  variable.  This  result 
should  not  be  interpreted  as  indicating  that  altitude  has  no  value  for 
target  acquisition  since  the  altitudes  used  are  not  representative  of  the 
tactical  pop-up  maneuver  and  probably  lie  well  beyond  the  altitudes  where 
the  aspect  angle,  and  hence  the  visibility  of  ground  targets,  is  changing 
most  rapidly.  The  limitations  of  an  experiment  in  which  a  seated  Observer 
must  be  transported  over  a  terrain  model  in  subscale  dictated  the  high 
altitudes  used.  Keeping  all  dimensions  to  a  minimum,  the  minimum  distance 
of  the  Observer's  eye  to  the  terrain  table  surface  was  4  feet,  hence  the 
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800  foot  minimum  altitude  at  the  200:1  scale.  It  is  concluded  that  this 
constraint  weakened  the  experiment  with  respect  to  this  variable  to  the 
point  that  the  results  are  of  little  value. 


Figure  7-12.  Effect  of  Altitude,  Rotary  Wing 


7.8  Target  and  Background  Coloration 

In  sub-experiment  5,  the  only  sub-experiment  in  which  colora¬ 
tion  was  a  variable,  the  effects  of  color  were  minor. 

The  negligible  effect  of  target  coloration  was  not  expected. 
Subjectively,  the  pattern  painted  tank  appeared  to  be  different  from  the 
OD.  In  the  SEEKVAL  IA1  experiment,  target  acquisition  time  for  green  and 
brown  tanks  was  significantly  better  than  that  for  grey  tanks;  the  search 
time  differences  between  green  and  brown  tanks  were  not  significant.  Sub¬ 
experiment  5  appears  to  parallel  the  results  reported  in  IA1  in  that  OD 
and  pattern  painted  coloration  differences  were  not  significant  while 
beige  was  different.  Detailed  analyses  of  the  impact  of  target  coloration 
were  made  in  several  ways  to  try  to  determine  whether  clutter,  range, 
search  method.  Observer  experience,  or  background  color  were  in  any  way 
influencing  the  results.  No  interactions  or  trends  were  apparent.  It  must 


be  concluded  that  the  target  coloration  used  in  sub-experiment  5  had  no 
effect  upon  target  acquisition  performance.  Figure  7-13  presents  the 
effect  of  target  coloration  on  cumulative  probability  of  target  acquisition. 


Figure  7-13.  Effect  of  Target  Coloration  on 
Target  Acquisition 


The  data  from  the  other  four  sub-experiments  indicate  that 
certain  target  colorations  may  be  important,  in  spite  of  the  results  cited 
above.  As  reported,  the  low  contrast  targets  (lighter  colored)  were 
usually  acquired  more  rapidly  but  not  always  at  longer  ranges  than  were 
the  higher  contrast  targets.  While  this  result  does  not  agree  with  the 
predicted  effects  of  contrast,  it  is  similar  to  that  reported  in  Experiment 
IA1  for  grey  tanks. 

The  effects  of  background  coloration  were  slightly  more  pro¬ 
nounced  than  those  of  target  colors,  but  not  significant.  It  will  be  noted 
from  Figure  7-14  that  the  green  background  yielded  a  slightly  better 
probability  of  acquisition  than  the  brown  background. 
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Figure  7-16.  Effect  of  Observer  Training,  Rotary  Wing 
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The  trained  Observer,  either  fixed  wing  or  helicopter,  was 
also  more  efficient  in  finding  targets  in  conditions  of  clutter,  the  most, 
significant  of  variables.  Table  7-VI  presents  the  relative  efficiency  of  the 
two  groups  as  a  function  of  clutter  conditions.  In  the  low  clutter  case 
the  two  groups  are  nearly  equal  (rates  approximately  1.0).  In  medium  and 
high  clutter  the  trained  Observers  were  more  efficient  in  acquiring  targets. 


TABLE  7-VI.  RATIO  OF  TARGET  ACQUISITIONS 
EFFICIENCIES,  TRAINED  TO 
UNTRAINED  OBSERVERS 


Clutter 

Fixed  Wing 

Helicopter 

Overa 1 1 

Low 

1.06 

1.005 

1.06 

Medium 

1.40 

1.17 

1.23 

High 

1.25 

1.26 

1.25 

I 
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OVERALL  CONCLUSIONS  AND  RECOMMENDATIONS 


The  conclusions  in  this  section  are  addressed  both  to  the 
overall  objectives  of  the  SEEKVAL  program  and  to  the  specific  objectives 
of  the  IB1  experiment.  The  recommendations  are  offered  for  the  con¬ 
sideration  of  future  experimenters  in  the  field  of  target  acquisition. 

8.1  Objective  of  the  SEEKVAL  Program 

The  overall  objective  of  the  SEEKVAL  program,  as  stated  in 
WSEG  Report  196,  is  to  evaluate  alternative  systems  and  techniques  for 
acquiring  targets  in  combat  air  support  missions.  It  is  concluded  that 
this  objective  was  served  in  the  IB1  Experiment  in  that  four  modes  of 
target  acquisition  were  evaluated  in  the  fixed  wing  sub-experiments  and 
three  modes  were  evaluated  in  the  rotary  wing  sub-experiments. 

The  evaluations  were  limited  to  search  modes  where  the  use  of 
direct  visual  search  was  always  possible  and  thus  excluded  direct  applica¬ 
tion  to  those  systems  in  which  the  Observer  is  constrained  to  the  use  of 
a  search  aid.  Since,  for  the  near  future  at  least,  most  target  acquisi¬ 
tion  hardware  will  use  direct  visual  search  as  an  integral  part  of  the 
target  acquisition  process,  the  IB1  experiment  did  address  the  immediate 
needs  of  target  acquisition  research. 

8.2  Objectives  of  the  IB1  Experiment 

The  source  document  for  the  design  and  conduct  of  the  IB1  ex¬ 
periment,  WSEG  Report  230  states  that,  "The  primary  objective  of  the  Aided 
Visual  Terrain  Table  Experiments  is  to  determine  the  relative  effective¬ 
ness  of  visual  search  aided  by  an  acquisition  sensor  as  compared  with 
direct  visual  search  alone.  The  experiments  should  also  demonstrate  the 
utility  of  terrain  tables  as  tools  for  the  continuing  evaluation  of 
alternative  target  acquisition  systems  and  techniques."  The  success  of 
the  experiment  in  meeting  this  objective  is  assessed  as  follows: 

JL  Determination  of  Relative  Effectiveness  of  Search  Methods 

This  objective  was  accomplished.  The  interpretation  of  the 
results  in  terms  of  quantitative  measures  is  addressed  in 
Section  7.1.  Although  the  search  methods  did  not  display 
a  consistent  direction  of  influence,  the  visual  aids  showed 
some  benefit  at  the  longer  ranges  (beyond  4500  meters)  and 
possibly  could  be  helpful  for  rotary  wing  testing  at  longer 
ranges  than  established  for  sub-experiments  4  and  5.  However, 
any  visual  aids  utilized  must  be  flexible  enough  so  that 
direct  vision  can  be  readily  substituted  when  appropriate. 

Aids  must  not  introduce  a  task  complexity  that  negates 
their  operational  effectiveness.  The  helmet-sight-controlled, 
variable-f ield-of-view  sensor  used  in  the  fixed  wing  experi¬ 
ments  appeared  to  meet  these  criteria. 


2  Demonstration  of  Terrain  Table  Utility 

Any  final  judgment  as  to  the  effectiveness  of  this  experi¬ 
ment  in  meeting  this  objective  must  await  the  results  of 
the  SEEKVAL  IE  Experiment  (flight  tests  at  Fort  Lewis, 
Washington)  which  is  specifically  designed  to  determine 
the  validity  of  the  IB1  and  IB2  Experiments.  It  can  be 
stated  at  this  time,  however,  that  the  IB1  results  do 
correlate  well  with  other  terrain  table  experiments  and 
flight  tests. 

a  Fixed  Wing 

The  SEEKVAL  IA1  experiments  conducted  at  the  AMRL 
facility  used  a  small  (1000:1  scale)  terrain  table. 

In  the  first  experiment  conducted  there,  the  Observer 
flew  by  the  target  at  3500  feet  altitude  and  300  knots 
(simulated)  rather  than  over  it.  The  total  rate  of 
acquisition  for  that  experiment,  based  on  108  total 
trials,  was  40  percent.  This  is  almost  the  same  as 
the  overall  acquisition  rate  achieved  in  the  fixed  wing 
sub-experiments  of  the  IB1  experiment  (see  Figure  8-1) . 
In  a  series  of  fixed  wing  target  acquisition  studies 
conducted  in  the  Martin  Marietta  Optical  Laboratory  at 
600:1  scale  for  the  Office  of  Naval  Research,  the 
overall  rate  of  acquisition  was  43  percent  (Fowler  and 
Jones,  1972). 1  Finally,  in  the  recent  summary  of  target 
acquisition  research,  the  reported  typical  field  test 
mean  range  of  acquisition  of  three  vehicles  under  con¬ 
ditions  of  clear  (10  nautical  mile)  visibility  was 
4250  meters  (Jones  et  al.,  1974).  Typical  mean  rrnge 
of  acquisition  of  three  vehicles  from  other  terrain 
table  experiments  was  similarly  reported  as  4570  meters. 
Combining  all  three  IB1  fixed  wing  experiments  using 
three  tanks,  the  mean  range  was  4878  meters.  Thus,  it 
can  be  concluded  that  the  800:1  scale  fixed  wing  simula¬ 
tion  was  valid,  the  results  typify  those  of  other 
simulations,  and  the  data  should  be  directly  correla- 
table  with  field  tests. 

Rotary  Wing 

The  helicopter  simulations  conducted  at  200:1  scale  and 
at  much  shorter  initial  ranges,  represented  a  different 
set  of  Observer  conditions  and  tasks.  The  IA1  tests  in¬ 
cluded  one  helicopter  simulation  at  1000:1  scale.  In 
IA1  the  helicopter  range  varied  from  2050  to  2350  meters 

F.  D.  Fowler  and  D.  B.  Jones,  Target  Acquisition  Studies  (Final  Report), 
Martin  Marietta,  Orlando,  Florida,  OR  11,901,  April  1972. 
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Figure  8-1.  To  Lais  for  Sub-Experiments  1,  2,  and  3,  Fixed  Wing 


at  various  altitudes  from  583  to  2000  feet.  The  number 
of  tank  targets  -  1,  3  or  9  -  was  a  primary  variable. 
Since  IB1  sub-experiments  4  and  5  used  only  three 
targets,  we  can  compare  the  three  target  case  only. 

The  rate  of  acquisition  in  the  IA1  helicopter  series 
for  three  targets  was  56  percent  (20  correct  acquisi¬ 
tions  in  36  attempts).  In  sub-experiments  4  and  5  of 
the  IB1  experiment,  the  rate  of  acquisition  was  88 
percent  (Figure  8-2) .  No  other  helicon  >r  simulations 
using  terrain  tables  are  reported  in  th.  literature. 

In  a  helicopter  field  test  conducted  at  Naval  Weapons 
Center,  China  Lake,  at  altitudes  below  800  feet,  the 
overall  rate  of  acquisition  was  76  percent, ^  with  the 
ranges  of  acquisition  tending  to  be  less  than  2000 
meters.  Other  helicopter  field  tests  of  target 


P.  H.  Amsendson,  A.  Schlarta  and  R.  Sorenson.  Helicopter  Operational 
Test  Target  Acquisition,  Naval  Weapons  Center,  China  Lake,  California, 
NWC  TP  5591,  January  1974. 


acquisition  have  been  conducted  by  the  U.S.  Army  (Moler 
1962;2  Monty,  Hicks  and  Moler,  1966;^  Bryson  1972;^ 
Barnes  1974*) .  In  general  these  field  tests  emphasized 
low  level  and  nap  of  the  earth  flying;  they  reported 
much  lower  rates  of  acquisition  (approximately  40  to 
60  percent)  at  shorter  ranges  than  were  the  case  in 
IB1.  For  direct  view  experiments,  it  is  difficult  to 
simulate  low  level  or  nap  of  the  earth  flying  with 
terrain  tables. 


2 

C.  G.  Moler,  Helicopter  Armament  Program,  Air-to-Ground  Target  Detection 
and  Identification.  Human  Engineering  Laboratory,  Aberdeen  Proving 
Ground,  Md.  TM  1-62,  January  1962. 

3 

R.  A.  Monty,  S.  A.  Hicks  and  C.  G.  Moler.  Acquiring  and  Relocating  Targets 
from  a  Helicopter:  A  Preliminary  Investigation,  U.S.  Army  Human  Engineer¬ 
ing  Laboratory,  Aberdeen  Proving  Ground,  Md.,  TM  2-66,  January  1966. 

4 

M.  R.  Bryson,  Air-to-Ground  and  Ground-to-Air  Detection  Experiments.  In 

D.  B.  Jones  (Ed.)  ONR  Target  Acquisition  Symposium,  November  1972. 

Martin  Marietta  Corp.  Orlando,  Florida,  January  1973. 

^J.  A.  Barnes,  Human  Engineering  Laboratory  Helicopter  Acquisition  Test 
(HELHAT) .  U.S.  Army  Human  Engineering  Laboratory,  Aberdeen  Proving 
Ground,  Md.  TM  20-79,  September  1974. 
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8.3 


Recommendations 


The  results  of  this  experiment  provide  some  measure  of  the 
variables  affecting  target  acquisition,  as  well  as  pose  several  intriguing 
questions.  The  following  recommendations  for  additional  research  have  been 
developed  from  the  results  of  the  experiment. 

.1  The  terrain  table  simulation  should  be  validated  by  field 
tests  conducted  under  similar  conditions  and  with  similar 
key  experimental  variables.  (Note:  the  design  for  Ex¬ 
periment  IE  is,  within  the  constraints  of  budget,  time, 
and  aircraft  availability,  well  suited  to  comply  with 
this  recommendation.) 

2^  The  search  methods  should  be  evaluated  under  conditions 
where  the  appropriate  number  of  Observers  is  constrained 
to  use  the  visual  aids . 

f 

3^  The  definition  of  clutter  should  be  standardized  to  in¬ 
clude  not  only  size,  shape,  and  number,  but  contrast 
relative  to  the  target. 

4^  The  effect  of  clutter  items  in  the  10  to  20,  20  to  60, 
and  greater  than  60  similar  objects  in  the  target  area 
should  be  evaluated. 

_5  The  nature  of  the  effects  of  contrast  in  target  acquisi¬ 
tion  situations  should  be  further  evaluated.  The  effects 
of  targe t-to-background  contrasts  from  -0.10  to  -0.40 
should  be  evaluated  and  a  more  precise  mathematical 
description  developed. 

6^  The  effects  of  target/background  coloration  and  contrast 
should  be  further  evaluated. 

_7  The  solar  simulation  technique  should  be  validated  by  using 
the  terrain  table  in  natural  sunlight  as  well  as  by  correla¬ 
tion  with  field  test  data. 

8^  At  least  two  more  sun  elevations,  below  20  degrees  and 
above  40  degrees,  should  be  tested.  A  mathematical 
description  of  sun  elevation  effects  should  then  be 
developed. 

9^  The  relative  effect  of  target  formations  and  deployment 
more  typical  of  those  tactically  expected  should  be 
evaluated. 


10  The  zero  target  case  should  be  experimentally  evaluated 
using  more  precise  controls  on  observer  behavior  and 
better  measures  of  that  behavior. 

11  The  effects  of  repeated  runs  over  the  same  target  area 
should  be  tested  and  a  reasonable  description  of  the 
effects  of  learning  on  target  acquisition  be  developed. 
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APPENDIX  A 

PROJECT  MANAGEMENT, 
ORGANIZATION,  AND  RESPONSIBILITIES 


»  1.0  Management  • 

The  SEEKVAL  Joint  Test  Force  (JTF)  was  responsible  for  the 
overall  management  of  the  Aided  Visual  Terrain  Table  Experiment.  The  JTF 
Director  managed  and  directed  the  test  within  the  limits  established  by 
—  DDR&E.  The  Project  Manager  was  responsible  for  on-site  management  of  the 

experiment.  The  SEEKVAL  JTF  coordinated  services  and  commands  partici-  • 

pating  in  the  experiment. 

On  June  28,  1974,  Martin  Marietta  Corporation,  Orlando, 

Florida,  was  placed  under  contract  to  conduct  Experiment  IB1.  The  contract 
[  called  for  laboratory  preparation,  conduct  of  the  experiment,  and  analysis 

of  the  results.  The  Project  Plan  was  published  by  the  JTF  in  October  1974.  P 

The  experiment  started  on  December  9,  1974,  and  concluded  on  March  6,  1975. 

Organization 

The  Martin  Marietta  SEEKVAL  team  under  the  control  of  the 
Joint  Test  Director  (JTD) ,  was  organized  as  shown.  P 


2.0 


SEEKVAL 


» 


I 


3.0  Responsibilities 

Responsibilities  of  the  various  organizations  involved  in 
SEEKVAL  Experiment  IB1  were  as  follows: 

1  The  Joint  Test  Director 


Provide  overall  management  and  financial  support 

2^  The  Department  of  the  Navy 

a_  Provide  48  fixed  wing  aviators/Observers  as  required 
in  the  project  test  plan 

Id  Provide  additional  technical  and  materiel  support  as 
required. 

3_  The  Department  of  the  Army 

a  Provide  a  Project  Manager  to  plan  and  conduct  the 
experiment 

b_  Provide  106  rotary  wing  aviators/Observers  as  required 

£  Provide  additional  technical  and  materiel  support  as 
required. 

The  Department  of  the  Air  Force 

£  Provide  66  fixed  wing  aviators/Observers  as  required 

b^  Provide  additional  technical  and  materiel  support  as 
required. 

5.  The  Commandant  of  the  Marine  Corps 

£  Provide  68  (50  rotary  wing/18  fixed  wing)  aviators/ 
Observers  as  required 

b.  Provide  additional  technical  and  materiel  support  as 
required. 

6^  The  Martin  Marietta  Corporation 

£  Provide  and  configure  a  suitable  terrain  table  and 
solar  simulator 


Id  Collect,  organize,  and  analyze  the  data  and  publish  the 
final  report  under  approval  by  the  JTD 
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APPENDIX  B 


OPTICAL  LABORATORY  SETUP 


Martin  Marietta  conducted  SEEKVAL  Experiment  IB1  in  the  Optical 
Laboratory  of  the  Guidance  Development  Center.  The  physical,  electrical, 
and  computational  elements  of  the  experimental  setup  are  described  in  this 
appendix. 


1.0  GDC  Description 

a.  General  Description 

Electro-optical,  IR,  and  laser  systems  are  evaluated  using 
a  40  x  40  foot  movable  terrain  model.  The  terrain  features  movable  targets, 
changeable  scale,  and  full  side  curtains  to  simulate  horizons.  The  terrain 
can  be  used  either  indoors  or  out,  depending  on  the  weather  and  the  condi¬ 
tions  to  be  simulated.  Equipment  under  test  is  normally  mounted  in  a  gim- 
baled  flight  table  capable  of  simulating  yaw,  pitch,  and  roll  movements. 

The  table,  in  turn,  is  mounted  to  a  transport  that  is  free  to  move  both 
laterally  and  vertically.  For  SEEKVAL  Experiment  IB1,  the  habitat  (cockpit) 
was  mounted  in  place  of  the  gimbal.  Simulation  parameters  pertinent  to 
SEEKVAL  at  800:1  and  200:1  scales  are: 


800:1 


200:1 


Slant  range 
Altitude 
Lateral  range 
Horizontal  velocity 
Vertical  velocity 
Lateral  velocity 


15  km 
16,000  ft 
32,000  ft 
to  8,000  ft/sec 
to  4,800  ft/sec 
to  3,200  ft/sec 


3.75  km 
4,000  ft 
8,000  ft 
to  2,000  ft /sec 
to  1,200  ft/sec 
to  800  ft/sec 


b.  Illumination  and  Contract 


The  optical  room  lighting  is  a  combination  of  low  ripple 
(1  percent  maximum)  and  fluorescent  lighting.  The  low  ripple  system  is 
provided  by  750  watt  incandescent  lamps  giving  approximately  200  foot- 
candles  36  inches  above  the  floor.  These  lamps  are  used  with  the  fluores- 
cents  to  simulate  a  very  bright  sunlight  day,  or  alone  if  the  sensor  is 
sensitive  to  60  cycle  flicker  from  the  fluorescent  system.  The  fluores¬ 
cent  system  provides  500  foot-candles  and  may  be  reduced  by  increments  of 
50  foot-candles. 


With  this  type  of  lighting,  a  wide  variety  of  illumination 
profiles  may  be  generated.  The  desired  illumination  levels  are  achieved  by 
making  measurements  with  a  foot-candle  meter  at  various  fixed  points  in  the 
laboratory  while  adjusting  the  lighting  controls. 


P 


P 


P 
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Target  contrast  on  the  terrain  model  is  determined  by 
photometering  the  target  and  its  background  from  the  position  of  the  test 
sensing  element.  The  target  contrast  is  then  computed  from  the  difference 
in  luminance  values  of  the  target  and  its  background  by  the  formula: 


C 


where : 


C  =  contrast 


B  =  background  brightness  in  foot  lamberts 
T  =  target  brightness  in  foot  lamberts 


c.  Transport  Mechanisms 

1)  Longitudinal  Transport  Mechanism 

The  3-D  terrain  model  is  mounted  on  15  trucks,  the 
five  central  trucks  with  compound  bearings  provide  lateral  guidance  in 
addition  to  vertical  support.  The  trucks  allow  longitudinal  translation 
of  the  assembly  on  three  tracks.  The  characteristics  of  the  terrain  model 
longitudinal  drive  assembly  are  listed  below. 


Displacement 

Velocity 


Acceleration 

Positioning 


Small  signal  amplitude 
Small  signal  frequency 
response 
Grain  margin 
Transient  response 
Settling  time 
Weight  of  longitudinal 
drive  system 


+80  feet  plus  10  feet  on  either 
end  for  acceleration 
Accuracy  at  min  +5  percent  at 
0.1  ft/s 

Accuracy  at  max  +2  percent  at 
10  ft/s 
+8.0  ft/s^ 

Accuracy  +1.0  inch 
Repeatability  0.62  inch  max 
(over  any  4  ft  span) 

0.28  ft/s 
3.0  cps 

9  dB 

10  percent  overshoot 

1.5  sec  for  maximum  step  input 
22,000  lbs,  static  and  rolling 
friction  less  than  250  lbs 


The  3-D  terrain  model  is  mechanized  to  simulate  the  longitudinal  movement 
of  the  vehicle  in  flight  and,  therefore,  accounts  for  one  degree  of 
freedom. 
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2)  Vertical  and  Lateral  Transport  Mechanisms 


The  remaining  two  degrees  of  translational  freedom  to 
simulate  vertical  and  lateral  movement  of  the  vehicle  are  provided  by  a 
laterally  translating  carriage  and  a  horizontal  beam.  The  carriage  is 
attached  to  a  horizontal  beam  which  is  free  to  move  vertically  between  two 
supporting  columns.  The  operating  characteristics  of  the  lateral  and  vertical 
drive  systems  are  listed  below. 

Lateral  and  Vertical  Drive  Characteristics 


Displacement 

Velocity 

Accuracy  at  minimum 
Accuracy  at  maximum 
Accelerat ions 
Accuracy 
Repeatability 

(over  any  4  ft  span) 
Small  signal  amplitude 
Small  signal  frequency 
response 


Lateral 

38  ft 

4.8  percent  at  0.004 

1.8  percent  at  4.0  ft/s 
2.7  ft/s2 

+1.0  in . 

0.062  in.  max 

0.1  ft/s 
3.0  cps 


Vertical 
25  ft  7  in 

4.8  percent  at  0.006  ft/s 

1.8  percert  at  6.0  ft/s 
6.0  ft/s2 

+1.0  in . 

0.062  in.  max 

0.25  ft/s 
3.0  cps 


Gain  margin  of  the  servo  system  is  approximately  9  dB  and  the  transient 
response  of  the  system  is  limited  to  10  percent  overshoot . 


d.  Computer  Laboratory 

The  GDC  computers  (Figure  B-l)  mathematically  implement 
aerodynamics,  kinematics,  and  autopilot.  The  computer  laboratory  is 
essentially  the  central  control  room  where  all  data  is  normally  gathered. 
The  computers  comprise  the  elements  listed  below. 


GDC  Hybrid  Computer  Complement 


Digital  Computers 

Sigma  5 

Memory  Size 
Word  length 
Memory  cycle  times 
Arithmetic 

Analog  Computers 

(231R ' s  and  231R-V's) 

Number  of  consoles 

Total  number  of  amplifiers 

Quarter-square  multipliers 

Resolvers 

Potentiometers 

Function  generators 


32k  words 
32  bits 
1.0  ps 

Fixed  point  and  floating  point 


6 

1320 

252 

12 

960 

59 


Hybrid  Interferace 

(digital  computers/231R-V) 

Multiplier  and  Digital 

to  analog  converts  56 

Analog  to  digital 

converter  channels  32 

Number  of  servo  pots  450 

Peripheral  devices  -  Sigma  5 

Card  reader  400  card/min 

Mag  tapes  75  sec 

200/556/800  bits/inch 

Line  printer  600  lines/min 

132  char/line 

Disk  storage  3.0  Mbytes 

The  operating  system  software  for  the  hybrid  computer  system  is  as  follows: 

Operating  System  Software 

Xerox  Data  Systems  supplied  software 
Real-time  batch  monitor 
MACRO  assembler 
FORTRAN  compiler 
Loader 
RAD  Editor 
Math  Library 
Diagnostics 

Software  written  by  Martin  Marietta  Aerospace 
On-line  debug  (CASPRE) 

Functional  table  processor 
Analog  setup 

Hybrid  run-time  Library 
Set  pots 

Real  digital  voltmeter 
Select  address 
Select  mode 
Set  DAC's 

e.  Data  Recording 

In  addition  to  the  digital  computer  recording  device,  the 
GDC  has  six  8-channel  oscillograph  recorders,  oscilloscopes,  and  television 
monitors  available  for  real-time  evaluation.  A  video  tape  recorder  is 
available  to  record  the  television  signal  and  other  tape  recorders  are 
available  for  recording  high  frequency  data.  Seventeen-inch  X-Y  plotters 
are  available  for  special  recording  techniques. 


Convert  ADC 

Set  control  lines 

Read  sense  lines 

Read  data  input  register 

Load  data  output  register 


f.  Control  Consoles 


Consoles  control  translational  and  rotational  drive  as  well 
as  lighting  and  closed  circuit  TV.  In  general,  the  consoles  provide  mode  of 
operation  (velocity  or  position  and  manual  or  computer  control),  manage  the 
general  signal  routing,  and  provide  the  outlets  for  availability  of  selected 
parameters  to  be  measured.  The  control  console  has  provisions  for  manually 
introducing  a  position  or  rate  command  for  each  of  the  six  degrees  of  freedom, 
independently  or  simultaneously. 

2.0  SEEKVAL  Laboratory  Configuration 

a.  Habitat  and  Experimenter's  Station 

1)  Structural 

The  habitat  is  shown  in  Figures  B-2,  B-3,  and  B-4. 

It  is  constructed  of  3  inch  by  3  inch  by  1/8  inch  thick  steel  tube  and 
carries  an  aircraft  seat  for  the  occupant.  The  Experimenter's  station, 
shown  in  Figures  B-3  and  B-4,  is  of  similar  construction. 

2)  Furnishings  and  Equipment 

The  TV  camera  and  the  gimbaled  mirror  system  were 
mounted  on  a  common  base  plate  which  was  positioned  above  and  in  front  of 
the  habitat  occupant's  head  by  an  adapter  frame  as  shown  in  Figure  B-2. 

This  placed  the  gimbaled  mirror  6  inches  above  and  12  inches  in  front  of 
the  Observer's  eye.  The  interior  of  the  habitat  had  rudder  pedals  (in¬ 
operative),  a  gimbaled  mirror  hand  controller  on  the  left  side,  and  a  TV 
monitor  mounted  where  the  instrument  panel  would  normally  be  located. 

Shelves  were  provided  on  the  back  of  the  habitat  to  carry  electronics 
associated  with  the  gimbaled  mirror  and  the  MOVTAS  Helmet  Sight. 

The  Experimenter's  station,  Figure  B-2,  carried  a  CRT 
terminal  and  a  keyboard  that  was  used  by  the  Experimenter  to  communicate 
with  the  simulation  system.  The  keyboard  was  in  front  of  the  Experimenter 
while  the  CRT  terminal  was  about  23  degrees  to  the  left  of  center  and  in¬ 
clined  at  about  25  degrees.  The  terminal  was  located  to  the  left  in  order 
that  it  would  not  interfere  with  the  Experimenter's  view  which  was  directed 
ahead  and  to  the  right. 

3)  Mounting 

Both  units  were  mounted  on  the  horizontal  beam  of  the 
simulation  system  as  shown  in  Figures  B-3  and  B-A.  The  habitat  attached  to 
the  existing  lateral  carriage  while  the  Experimenter's  station  ran  on  the 
beam  rails  using  a  set  of  caster  wheels.  Both  units  fa’ed  north  and  the 
Experimenter's  station  was  on  the  west  side  of  the  habitat.  The  two  were 
fastened  together  and  moved  over  the  beam  by  the  lateral  carriage  drive. 

The  seating  was  arranged  such  that  the  Experimenter  sat  one  foot  higher 
than  the  Observer. 
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Habitat 


4)  Sensor/Subject  Parallax 


The  problems  of  parallax  in  sub-scale,  combined  direct 
and  aided  view  simulations  are  well  known  and  will  not  be  reiterated  here. 
The  position  of  the  sensor  gimbaled  mirror  with  respect  to  the  Observer's 
eye  did  not  produce  an  appreciable  parallax  effect  at  the  line  of  sight 
depression  and  azimuth  angles  normally  encountered  during  the  experiments. 

A  truly  coaxial  line  of  sight  achieved  through  the  use  of  a  combining  glass 
"windscreen"  was  not  considered  feasible  due  to  the  large  combining  glass 
required  to  accommodate  the  gimbaled  mirror's  angular  freedom  and  the  effect 
of  the  light  loss  of  such  a  system  on  the  sensor  lens  f-stop/depth  of  focus 
requirement . 


5)  Out-of-Canopy  Masking 

The  habitat  masking  angles  were  plotted  using  the 
MOVTAS  helmet  sight.  The  Observer  scanned  from  extreme  left  to  extreme 
right  along  the  upper  edges  of  the  habitat  sides  and  nose  while  azimuth 
and  depression  angles  were  recorded  from  the  analog  computer  readout  system. 
Figure  B-5  shows  the  masking  angles. 

b.  Illumination 

Lighting  for  SEEKVAL  Experiments  IB1  was  supplied  by  the 
existing  fluorescent  overhead  lighting  supplemented  by  the  solar  simulator 
lamp.  The  fixed  wing  experiments  (sub-experiments  1,  2,  and  3)  used  500 
foot-candle  overhead  lighting  only  (to  simulate  an  overcast  sky)  for 
approximately  25  percent  of  the  runs  in  sub-experiment  1  and  all  of  2.  The 
remaining  75  percent  of  sub-experiment  1  and  all  of  3  required  both  solar 
simulation  and  overhead  lighting  such  that  the  solar  source  provided  an 
intensity  at  the  terrain  model  surface  five  times  that  of  the  overhead 
lighting  to  produce  a  realistic  shadow  contrast.  These  values  were  100 
foot-candles  overhead  and  500  foot-candles  from  the  solar  simulator. 

Because  of  the  physical  configuration  of  the  optical  room,  a  sun  shield 
structure  was  provided  to  prevent  actual  sunlight  from  impinging  on  the 
model  through  the  open  door  (the  door  had  to  be  open  to  permit  the  terrain 
model  to  pass  beneath  the  habitat). 

Rotary  wing  sub-experiments  4  and  5  used  the  diffuse 
overhead  lighting  only.  The  level  of  the  overhead  lighting  was  controlled 
by  switch  gear  controlled  from  the  test  conductor's  console  in  the  control 
room. 


The  light  source  for  the  solar  simulator  (Figure  B-3)  was 
a  high  output  xenon  arc  motion  picture  projection  lamp  system.  The  system 
selected  was  the  Strong  Electric  Model  X60B  lamphouse  with  a  150  ampere 
short-arc  xenon  bulb.  The  offshelf  lamphouse  was  modified  by  adding  an 
achromatic  lens  and  a  mirror  to  the  existing  lamphouse  aperture  to  correct 
for  beam  non-uniformity  caused  by  the  shadow  of  the  lamp  appearing  in  the 
far-field  beam.  The  approximately  3-inch  lamp  aperture  ensured  holding 
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shadow  edge  sharpness  to  about  1/2  degree  at  30  feet  from  the  aperture. 

Use  of  the  xenon  source  provided  a  reasonable  match  to  sunlight  for  color 
temperature.  The  area  on  the  model  illuminated  by  the  solar  simulator 
covered  a  single  target  area  (13.3  x  20  feet)  at  the  planned  sun  angles 
and  with  a  30  foot  beam  throw. 

The  solar  simulator  positioning  system  was  developed  around 
a  self-propelled  hydraulic  lift,  a  Del  Mar  Laboratories  DPL-20  Model  6B. 

The  lift  was  moved  around  the  terrain  to  the  appropriate  location  and  then 
secured  to  the  transporter  frame.  This  provided  support  against  overturning 
and  allowed  moving  the  solar  simulator  with  the  terrain  model. 

The  solar  simulator  lamp  was  mounted  on  the  end  of  the  boom 
using  a  pitch  gimbal  and  tilt/pan  mechanism.  The  lamp  power  supply  was 
located  at  the  base  of  the  lift,  its  weight  of  385  pounds  providing 
additional  protection  against  overturning. 

The  20-foot  reach  of  the  boom  permitted  positioning  of  the 
solar  simulator  for  several  target  areas  thus  permitting  multiple  runs 
without  repositioning  the  lift  truck. 

c.  Gimbaled  Sensor  and  Magnifying  Optics 

All  five  experiments  made  use  of  a  gimbaled  television 
sensor  with  a  variable  field  of  view  and  autofocus.  The  rotary  wing  experi¬ 
ments  used,  in  addition,  a  magnifying  optical  device  simulating  a  stabilized 
optical  system. 

1)  Two-Axis  Gimbal 

The  two-axis  gimbal  system  was  located  6  inches  above 
and  12  inches  in  front  of  the  Observer's  eye  position.  The  gimbal  was 
controllable  in  pitch  and  yaw.  The  system  employed  position  and  velocity 
commands  and  was  implemented  so  that  the  helmet  sight,  pantograph  sight, 
or  hand  controller  provided  line  of  sight  steering. 

The  Observer,  with  the  aid  of  the  hand  control  stick, 
was  able  to  center  the  TV  field  of  view  on  the  target.  This  was  done  in 
the  rate  mode.  Figure  B-6  shows  the  gimbaled  line  of  sight  field  of  regard 
on  the  terrain  model  surface  as  a  function  of  azimuth  position  but  without 
regard  to  habitat  structural  masking.  Habitat  masking  was  not  a  significant 
factor. 

2)  TV  System 

The  TV  camera  system  was  a  Cohu  6100  series  camera  with 
an  RCA  4532A  silicon-diode  array  camera  tube.  The  lens  was  an  Angineaux 
motorized  zoom  and  focus  system  with  a  15  to  150  mm  focal  length  capability 
using  a  2X  extender,  producing  a  horizontal  field  of  view  of  from  2.0  to 
24  degrees.  For  SEEKVAL  Experiment  IB1,  the  maximum  field  of  view  available 


Co  the  subject  was  8  degrees.  Wide  and  narrow  field  of  view  search  mode 
selections  were  made  from  the  console,  and  from  a  potentiometer  on  the 
top  of  the  control  stick  when  the  subject  was  to  control  zoom  in  the 
variable  field  of  view  search  mode.  The  focus  was  controlled  from  the 
analog  computer  as  a  function  of  gimbal  look-angle  and  position  of  the 
terrain  model  (Figure  B-7) . 

3)  Magnifying  Optics 

To  simulate  the  stabilized  magnifying  optics  re¬ 
quired  in  sub-experiments  4  and  5,  a  Kalimar  K-7001  zoom  scope  mounted 
above  the  pantograph  unity  power  sight  was  used.  This  device  featured  dual 
eyepieces  with  a  single  objective  lens  to  avoid  parallax.  The  zoom  feature 
was  not  used,  but  was  fixed  at  8  power. 

d.  Displays 

Displays  utilized  in  these  experiments  included  the  Ob¬ 
server's  and  the  test  conductor's  television  sensor  displays,  the  Ex¬ 
perimenter's  and  test  conductor's  data  displays,  and  the  test  conductor's 
control  and  status  indicators. 

1)  TV  Displays 

The  Observer's  TV  was  a  9-inch  diagonal  display, 
Setchell  Carlson  model  number  10M915,  with  variable  raster  size.  The 
display  was  turned  on  and  off  by  switching  the  video  on  and  off  with  a 
coaxial  relay.  The  average  distance  from  the  TV  face  to  the  Observer's 
eye  was  30  inches.  The  test  conductor's  monitor  was  a  5-inch  aircraft  type; 
the  sensor  camera's  output  was  displayed  during  all  runs. 

2)  CRT  Data  Display  System 

Figure  B-8  illustrates  the  components  and  character¬ 
istics  of  the  Xerox  BC-200  display  system.  The  CRT/keyboard  at  the 
Experimenter's  station  allowed  2-way  communication  to  the  Sigma  5  digital 
computer.  The  CRT  at  the  test  conductor's  station  allowed  the  test  con¬ 
ductor  to  monitor  progress  and  results  of  each  run. 

3)  Control  and  Status  Indicators 

The  test  conductor's  and  Experimenters  control  con¬ 
soles  displayed  status  of  all  habitat  enabling/disabling  controls  (TV 
monitor,  zoom,  track  stick)  lighting  controls,  and  lab  drive  status, 
positions,  and  velocities. 
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and  Gimbal  Contro 


14"  BLACK/WHITE  CRT 
20  LINES,  80  CHARACTERS 


SEEKVAL  BC200  Display  System 


e.  Recording 
1)  Audio 


Two  audio  channels  were  used  in  the  SEEKVAL  IB1  ex¬ 
periments.  As  shown  in  Figure  B-9,  the  system  was  configured  to  exclude 
the  Observer  from  inputs  other  than  the  Experimenter’s  unless  the  test 
conductor  selected  the  executive  override  mode.  The  Experimenter  could 
switch  his  microphone  output  to  "subject,"  "lab,"  or  both.  Experimenter/ 
Observer  conversations,  and  audio  from  the  Experimenter's  microphone  in  the 
"both"  position  and  from  test  conductor's  microphone  in  the  "executive 
override"  position  were  recorded  on  audio  track  1  of  the  Sony  EV320  recorder. 
Lab  operator/test  conductor/Experimenter  conversations  were  recorded  on 
track  2.  The  Experimenter's  headset  always  received  mixed  audio  from  all 
microphones . 


2)  Video 

The  sensor  camera  in  the  habitat  was  operative  during 
all  runs.  In  the  direct  view  runs,  the  camera  was  set  to  its  widest  field 
of  view  and  used  to  record  the  entire  run.  For  runs  where  the  subject  had 
available  wide  field  of  view,  narrow  field  of  view,  or  zoom  as  an  aid  to 
acquisition,  the  video  record  provided  data  on  employment  of  the  sensor. 

3.0  Terrain  Table 

3.1  Surface  Configuration 

The  surface  was  basically  an  800:1  representation  of  a  relatively 
homogeneous  terrain  with  six  discrete  areas.  For  ease  of  discussion,  the 
zones  are  numbered  as  shown  in  Figure  B-10,  which  depicts  the  model  as  con¬ 
figured  for  fixed  wing  sub-experiments  1,  2,  and  3.  Zones  I  and  V  are 
duplicates  of  two  of  the  existing  SEEKVAL  target  zones  at  Fort  Lewis, 
Washington,  Zone  I  is  the  Weir  Prairie  area  which  lies  approximately  22 
kilometers  southwest  of  Grey  Army  Airfield.  Zone  V  is  the  13th  Division 
Prairie,  about  12  kilometers  southeast  of  the  airfield. 

Zones  II  and  III  are  representative  of  Central  Europe  area  in 
topography,  vegetation,  and  cultural  details,  and  Zones  IV  and  VI  are  a 
general  Fort  Lewis  representation. 

Figure  B-ll  shows  the  same  basic  terrain  table  as  it  was  con¬ 
figured  for  rotary-wing  experiments  4  and  5.  The  zones,  numbered  I  through 

IV  as  shown,  are  basically  the  same  as  the  fixed  wing  zones  I,  II,  IV,  and 

V  except  that  it  was  necessary  to  eliminate  some  Weir  Prairie  detail  to 
allow  a  large  enough  clearing  to  control  clutter  in  the  200  meter  radius 
required.  The  east-west  dirt  road  separating  the  southern  zones  from  the 
center  zones  for  the  fixed-wing  configuration  was  paved  for  the  rotary  wing 
configuration  to  provide  a  more  pronounced  demarcation. 
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Figure  B-9 .  Laboratory  Audio  System  and  Audio/Video 
Recording  System 
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Foliage 


The  vegetation  was  primarily  coniferous  with  some  random  mix 
of  deciduous  trees  similar  to  those  found  at  Fort  Lewis.  Several  different 
types  of  tree  construction  were  used  depending  upon  density,  tree  height, 
and  detail  required.  Clutter  elements  featured  fine  detail  so  as  not  to 
detract  from  the  realism  in  the  immediate  target  area. 

3.3  Buildings 

Buildings,  found  primarily  in  the  Central  European  areas,  were 
of  two  scales,  800:1  for  fixed  wing  experiments  and  200:1  for  rotary  wing. 

3.4  Target  Tanks 

Tank  models  representative  of  the  U.S.  M-60  were  provided  in 
two  scales.  Figures  B-12  through  B-19  show  examples  of  the  Observer's 
view  and  closeup  view  for  both  fixed  wing  and  rotary  wing  experiments  (two 
arrays  each).  Figures  B-20  and  B-21  are  closeup  views  of  pattern  painted 
(camouflage)  targets  in  different  clutter  configurations. 

3.5  Coloration 

An  important  aspect  of  the  design  of  these  experiments  was 
enabling  future  validation  of  the  simulation  by  flying  duplicates  of  some 
run  configurations  at  Fort  Lewis.  Since  atmospheric  effects  except  color 
cannot  be  duplicated  in  the  laboratory,  the  colors  used  were  idealized 
(i.e.,  brighter  than  life  as  seen  through  several  thousand  feet  of  atmos¬ 
phere)  in  order  to  permit  use  of  a  mathematical  model  accounting  for 
atmosphere  in  later  comparison  of  simulation  and  actual  runs.  This  de¬ 
cision  was  reached  because  it  would  be  more  difficult  later  to  partially 
account  for  atmosphere  (edge  effects,  sun  glare,  etc.)  than  to  use  a 
complete  atmospheric  model  accounting  for  all  effects,  including  apparent 
coloration.  The  use  of  bright,  highly  reflective  colors  also  enhanced  the 
television  sensor  f-stop/depth  of  focus  mechanization. 

4.0  Cockpit  Configuration  and  Search  Aids 

a.  Cockpit 

The  Observer's  cockpit  was  configured  essentially  as  de¬ 
scribed  in  Annex  A  of  SEEKVAL  Project  Plan  IB1.  However,  certain  develop¬ 
ments  and  improvements  occurred  in  the  actual  implementation  of  the  hard¬ 
ware  : 


1_  Structural  channels  were  installed  to  simulate  rudder 
pedals,  but  no  simulated  aircraft  control  stick  was 
provided 

2_  A  built-in  sheet  metal  shelf  at  the  Observer's  left 
provided  a  mounting  surface  for  the  track  stick  and 
a  location  for  storage  of  the  oblique  terrain  model 
photograph. 


Figure  B-15.  Close  Up  (Fixed  Wing) 
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Figure  B-16.  Observers 

View  (Rotary  Wing) 
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Figure  B-17.  Close  Up  (, Rotary  Wing) 


3_  A  doorway  and  a  welded-on  step  provided  access  from 
the  right-hand  side. 

4_  Movable  sheet  metal  masking  to  simulate  aircraft 

canopy  masking  was  found  to  be  unnecessary  and  was  not 
provided.  However,  for  the  rotary  wing  experiments,  a 
sheet  metal  shield  was  added  as  a  vertical  extension 
of  the  access  door  to  prevent  premature  over-the-side 
viewing  of  zones  III  and  IV  when  runs  were  being  made 
in  zones  I  and  II. 

5_  A  quick-acting,  flip  up  curtain  was  made  and  installed 
in  accordance  with  Martin  Marietta  drawing  SK  48063. 

The  curtain  material  was  a  white  opaque  plastic. 

When  the  run  "start"  button  was  pressed  by  the  Experi¬ 
menter,  the  curtain  flipped  up  and  out  of  the  way 
revealing  the  terrain  model  to  the  Observer  and  sen¬ 
sor.  The  curtain  flipped  down  obscuring  the  terrain 
model  from  the  Observer  and  sensor  when  the  run  was 
terminated  by  the  Observer,  the  Experimenter,  the 
test  conductor,  or  the  analog  computer  operator. 

This  device  was  used  for  the  initiation  and  termina¬ 
tion  of  each  run  in  all  experiments. 

6.  A  crewman's  seat  from  an  H-34  helicopter,  with  stan¬ 
dard  cushions,  seat  belt,  and  shoulder  harness,  was 
installed. 

Video  System 

1^  Martin  Marietta's  two-axis  gimballed  mirror  system 
(Castfire  type)  was  hard-mounted  together  with  the 
COHU  6100  series  video  camera.  These  units  were 
then  attached  to  the  Observer's  cockpit  structure 
by  means  of  a  very  heavy,  rigid  tubular  fitting. 

This  mounting  was  so  developed  that  the  center  axis 
of  the  gimballed  mirror  assembly  was  approximately 
6  inches  above  and  12  inches  in  front  of  the  Observer's 
eye.  The  look  angle  of  the  gimballed  mirror  system 
was  controlled  by  one  of  three  subsystems:  the  helmet 
sight,  the  pantograph  sighting  station,  or  the  track 
stick. 

2_  For  the  video  camera,  continuous  focus  adjustment  was 
obtained  by  supplying  analog  computer  data  (functions 
of  the  gimbal  look-angle  and  the  position  of  the 
terrain  model)  through  the  Automated  Lens  for  Infinite 
Conjugate  Emulation  (ALICE)  circuitry  to  the  Angineaux 
motorized  zoom  and  focus  system. 


3^  Video  outputs  were  supplied  to  the  Observer's  monitor, 
to  the  Experimenter's  monitor,  and  to  the  audio/video 
recorder  (Sony  EV320) . 

4^  During  all  active  TV  experiments  (both  fixed  wing  and 
rotary  wing)  the  gimballed  mirror  angle  and  hence  the 
look-angle  of  the  video  camera  was  controllable  by  the 
Observer  using  the  track  stick  when  track-stick  control 
has  been  activated.  In  the  fixed  wing  active  TV  experi¬ 
ments  the  alternative  look-angle  control  was  the  MOVTAS 
helmet  sight,  and  transfer  from  one  to  the  other  was 
accomplished  by  depressing  and  releasing  the  correct 
one  of  two  momentary  thumb  pushbutton  switches  on  the 
head  of  the  track  stick.  In  fixed  wing  active  TV 
experiments,  where  variable  field  of  view  (VF)  was 
called  for,  the  potentiometer  on  the  track  stick  head 
was  activated  so  that  the  Observer  could  zoom  from 
wide  field  of  view  (8  degree  FOV,  1:1  magnification) 
to  narrow  field  of  view  (2.0  degree  FOV,  3.3:1  magnifi¬ 
cation).  In  the  two  other  fixed  wing  active  TV  modes, 
wide  field  (WF)  and  narrow  field  (NF) ,  the  track  stick 
potentiometer  was  inoperative  and  the  field  was  adjusted 
from  the  test  conductor's  station.  In  rotary  wing 
active  TV  experiments  the  alternative  look-angle  con¬ 
trol  was  the  Operator's  sighting  station,  FSH1270-824- 
4501  (AH-1G  "Cobra”  gunner's  station).  Transfer  of 
control  from  the  track  stick  to  the  sighting  station 
and  back  was  accomplished  by  momentarily  depressing 
the  upper  or  lower  finger  triggers  on  the  control 
handles  of  the  sighting  station.  These  were  two  handles 
(L&R)  on  the  station  and  either  of  the  two  upper  trig¬ 
gers  shifted  control  to  the  track  stick  while  either 
of  the  two  lower  triggers  shifted  control  to  the  sta¬ 
tion.  For  all  rotary  wing  experiments,  the  shifting 
buttons  on  the  track  stick  were  inoperative. 

c.  Stabilized  Optics 

For  the  Stabilized  Optics  (SO)  runs  in  the  rotary  wing 
experiments,  a  stabilized  optical  device  was  simulated  by  a  Kalimar  Zoom 
Scope  mounted  on  the  top  of  the  sighting  station.  This  installation  pro¬ 
vided  a  manually  controllable  support  for  the  optics;  the  stabilization 
feature  was  not  required  since  there  was  neither  roll,  pitch,  yaw,  nor 
vibration  at  the  cockpit.  The  zoom  feature  of  the  scope  was  not  used  and 
the  magnification  was  set  at  8  power.  Prior  to  each  SO  run  the  scope  was 
individually  focused  for  each  Observer  on  targets  off  the  terrain  model 
at  the  correct  range.  This  scope  has  two  eyepieces  similar  to  standard 
binoculars,  but  a  single  objective  lens  to  eliminate  the  effects  of  parral- 
lax  due  to  inter-ocular  distance  at  the  200:1  scale  used. 


d.  Terrain  Model  Screening  for  Rotary  Wing  Experiments 

Since  the  200:1  scaling  of  the  targets  for  rotary  wing 
made  the  subsequent  runs  easily  subject  to  inadvertent  pre-run  observation 
and  since  the  fly-up  curtain  had  to  be  up  for  TV  equipment  operational  brief¬ 
ing  and  for  SO  focusing,  a  portable  screen  (approximately  4x8  feet)  was 
placed  on  an  easel  in  front  of  the  cockpit  to  preclude  pre-run  observation. 
After  the  flip-up  curtain  was  put  down  at  the  start  of  the  run-set,  the 
Experimenter  removed  the  easel  and  screen;  he  replaced  them  at  the  end  of 
the  run-set. 

e.  Observer's  Event  Marker  Switch  (or  "Triggering") 

In  all  fixed  wing  runs  and  in  rotary  wing  direct  view  runs, 
the  forefinger  trigger  on  the  track  stick  was  the  sole  means  for  the  Observer 
to  indicate  target  acquisition.  For  the  video  aided  (EO)  and  optically 
aided  (SO)  rims  of  the  rotary  wing  experiments,  two  thumb  pushbuttons  located 
on  the  control  handles  of  the  sighting  station  were  also  available  to  indi¬ 
cate  acquisition.  In  practice,  for  all  of  the  SO  runs  and  many  of  the  EO 
runs  these  were  used  in  lieu  of  the  track  stick  trigger  since  the  Observer’s 
hands  were  already  on  the  sighting  station  handle. 


APPENDIX  C 


PREVIOUS  RELATED  RESEARCH 


This  appendix  discusses  a  few  previous  experiments  that  are  of 
particular  interest  to  the  SEEKVAL  program.  For  a  comprehensive  review  of 
the  target  acquisition  literature,  see  Jones,  Freitag,  and  Collyer  (1974) 


1.0  Target/Background  Variables 

Some  variables  associated  with  the  targets  and  with  their  back¬ 
ground  characteristics  affect  target  acquisition.  Variables  such  as  size  and 
shape  are  specifically  target  characteristics;  others,  such  as  clutter,  re¬ 
late  to  the  background;  and  some  (contrast,  for  example)  are  associated 
with  both  target  and  background  characteristics.  Although  target  features 
can  be  varied  independently  of  the  background  (and  vice  versa) ,  target  acqui¬ 
sition  depends  on  the  interaction  effect  of  both  target  and  background 
variables. 


The  target/background  variables  of  concern  in  these  experiments 
are  target  number,  contrast,  coloration,  and  clutter.  Others  (such  as 
target  size  and  shape)  have  been  the  subject  of  many  laboratory  studies, 
simulation  experiments,  and  field  trials.  Target/background  contrast  and 
background  clutter  have  been  studied  in  carefully  controlled  laboratory 
I  experiments.  The  relatively  small  amount  of  flight  test  data  relating  these 

factors  to  target  acquisition  reflects  the  difficulty  of  controlling  and 
quantifying  them  under  flight  test  conditions.  Fortunately,  they  can  be 
studied  experimentally  by  high-fidelity  simulation  techniques. 

a.  Target /Background  Brightness  Contrast 

Target/background  brightness  contrast  is  a  way  of  quanti¬ 
fying  the  difference  in  brightness  between  the  target  and  its  immediate 
background.  It  is  usually  defined  as: 


- -  T 

Lb 

where  Lt  is  the  brightness  of  the  target  and  Lb  the  brightness  of  the  back¬ 
ground.  Contrast  thus  defined  may  be  positive  or  negative  according  to 
whether  the  target  is  brighter  than  its  background  or  vice  versa.  Negative 
contrasts  were  used  in  SEEKVAL  Experiment  IB1  (i.e.,  the  target  was  always 
darker  than  the  background) . 


D.B.  Jones,  M.  Freitag,  and  S.C.  Collyer,  Air-to-Ground  Target  Acquisition 
Source  Book:  A  Review  of  the  Literature.  Martin  Marietta,  OR  12,470, 
Orlando,  Florida,  September  1974  (AD  B000260L). 


In  most  target  acquisition  studies,  inherent  contrast 
(the  target/background  contrast  measured  at  the  real-world  target)  is  of 
less  significance  than  apparent  contrast  (the  contrast  between  target  and 
background  measured  at  the  Observer's  eye).  Apparent  contrast  results  from 
the  absolute  at-target  contrast  as  it  is  degraded  by  atmospheric  attenu¬ 
ation.  Apparent  contrast  as  used  in  SEEKVAL  Experiment  IB1  is  equivalent 
to  absolute  contrast  since  the  distances  involved  were  so  short;  no  attempt 
was  made  to  simulate  atmospheric  attenuation. 

The  effects  of  target/background  contrast  have  been  exten¬ 
sively  studied  both  analytically  and  in  laboratory  experiments  (see  Black- 
well,  1946;  Lamar,  et  al,  1947;  Taylor,  1960  (a)  and  (b);  Vos,  Lazet  and 
Bouman,  1956).  These  studies  are  primarily  concerned  with  contrast  thres¬ 
holds  for  simple  targets  of  different  sizes  against  uniform  backgrounds. 

There  have  been  few  field  tests  or  simulator  studies  of  air-to-ground  target 
acquisition  in  which  apparent  target/background  contrast  has  been  systematic¬ 
ally  varied.  Thackham,  Wade  and  Clay  (1966)  report  a  field  trial  in  which 
target  vehicles  were  located  under  conditions  of  "high,"  "medium,"  or  "low" 
contrast,  but  no  contrast  measurements  are  reported.  Their  results  showed 
that  the  high  contrast  condition  gave  significantly  longer  identification 
ranges  for  static  targets  than  the  low  contrast  condition. 

In  a  simulation  experiment,  Jones  and  Bergert  (1970) 
studied  the  effect  of  target/background  contrast  under  closely  controlled 
conditions  in  which  the  subject  viewed  the  Martin  Marietta  terrain  model 
directly.  The  contrast  values  of  the  targets  against  their  backgrounds 
ranged  from  -0.05  to  -0.15.  No  clutter  existed  within  1000  scaled  feet  of 
the  targets.  The  results  indicated  that  low  contrast  levels  (-0.05  to  -0.15) 
resulted  in  a  large  decrement  in  target  acquisition.  Contrast  greater  than 
-0.35  to  -0.40  had  negligible  effect. 

b.  Clutter 

Laboratory  experiments  have  shown  that  as  the  number  of 
objects  in  a  complex  visual  field  increases,  target  recognition  performance 
deteriorates  (Boynton  and  Bush,  1957;  Christner,  Schutz,  and  Ray,  1959; 

Williams  and  Borow,  1963).  In  air-to-ground  target  acquisition  tasks  the 
terrain  is  usually  cluttered  with  objects  other  than  the  target.  Simu¬ 
lations  and  field  studies  often  have  shown  that  the  same  effects  occur:  a 
greater  degree  of  clutter  usually  leads  to  a  deterioration  in  target  acqui¬ 
sition  performance.  However,  in  a  field  study  of  clutter  effects,  Whittenburg, 
et  al  (1959a)  compared  the  acquisition  of  targets  located  in  relatively  open 
areas  with  that  of  unconcealed  targets  placed  close  to  natural  terrain  ob¬ 
jects.  No  difference  in  performance  was  found.  Similarly,  a  simulator 
study  carried  out  by  Bergert  and  Fowler  (1970)  showed  that  a  background 
cluttered  by  non-target  objects  such  as  trees  or  rocks  did  not  significantly 
affect  the  subject's  ability  to  distinguish  the  targets,  as  compared  with 
open  field  backgrounds.  This  same  result  was  reported  by  Van  Arsdall  (1974). 
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A  major  problem  in  studying  the  effects  of  terrain  clutter 
is  that  of  quantifying  the  degree  of  clutter.  This  has  been  attempted  by 
Nygaard,  et  al  (1964)  using  various  forms  of  sensor  imagery,  including 
aerial  photographs.  Using  a  stimulus-complexity  analyzer  to  measure  over¬ 
all  background  complexity,  a  curvilinear  relationship  was  found  between  the 
analyzer  measure  of  total  object  count  and  recognition  performance  for  both 
photographic  and  infrared  imagery.  An  inverse  relationship  was  found  between 
target  recognition  time  and  mean  object  size  and  object-size  variance.  These 
results  suggest  that  it  is  possible  to  quantify  some  aspects  of  background 
complexity  in  relation  to  the  real  world. 

c.  Target  Number 

When  a  number  of  small  targets  are  situated  closely  to¬ 
gether,  the  effect  may  be  one  of  a  target  complex,  rather  than  one  of  in¬ 
dividual  targets.  Dukes  and  McEachern  (1955)  and  Van  Arsdall  (1974)  found 
that  grouped  targets  were  detected  more  often  than  ungrouped  or  single  ones. 
Whittenburg,  et  al  (1960a)  report  that  placing  a  series  of  different  tar¬ 
gets  less  than  3  seconds  flying  time  apart  tended  to  reduce  identification 
scores.  They  suggest  that  this  may  have  been  due  to  a  tendency  for  Ob¬ 
servers  to  "lock  on"  or  fixate  one  target  at  the  expense  of  others  nearby. 

It  appears,  therefore,  that  the  effects  of  grouping  heterogeneous  targets 
is  to  facilitate  detection  of  the  group,  but  it  may  impair  identification 
of  its  individual  members. 

d.  Coloration 

In  their  review  of  the  literature,  Jones,  Freitag,  and 
Collyer  (1974,  p.  3-22)  conclude  that  color  contrast  does  not  have  much 
effect  on  the  visual  range  of  target  acquisition,  primarily  because  of 
atmospheric  attenuation.  Using  photographic  imagery,  Kraft  and  Anderson 
(1973)  found  no  statistically  significant  difference  between  achromatic 
and  chromatic  imagery  when  displayed  either  stereoscopically  or  nonstereo- 
scopically.  However,  a  terrain  table  simulation  reported  by  Van  Arsdall 
(1974)  did  find  statistically  different  target  acquisition  performance  as 
a  function  of  target  color  contrast  with  a  green  terrain  background  when 
brightness  contrast  was  equated  for  the  three  tank  target  colors  (brown, 
green,  and  gray).  The  scale  of  the  terrain  table  (1000:1)  necessitated 
short  viewing  distances,  and  no  atmospheric  degradation  was  used  to  make 
the  simulation  approach  the  real  world  color  contrast  attenuation  by  the 
atmosphere. 


2.0  Environmental  Variables 

a.  Illumination  Level 

A  minimum  level  of  illumination  is  required  for  successful 
direct  vision  target  acquisition.  The  effect  of  illumination  is  such  that 
above  approximately  100  foot  lamberts,  increasing  illumination  level  does 
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not  improve  performance  (Jones,  et  al,  1974;  Duntly,  1948).  Field  trial 
reports  by  Whittenburg,  et  al  (1959b)  indicate  that  short  term  changes  in 
incident  illumination  did  not  have  a  significant  effect  on  target  acquisi¬ 
tion  performance. 

b.  Sun  Azimuth 

The  effect  of  sun  azimuth  angle  was  studied  in  both  field 
test  and  related  simulation  experiments  by  Blackwell,  Ohmart,  and  Harcum 
(1958).  They  found  that  mean  slant  range  of  target  acquisition  increased 
as  sun  azimuth  (relative  to  the  line  of  flight)  changed  from  3  degrees 
through  177  degrees  with  data  taken  at  45,  90,  and  122  degrees.  Similar 
results  were  reported  by  Gordon  and  Lee  (1959)  who  used  a  small  battle¬ 
field  simulation  model  with  very  low  level  (i.e.,  ground  observation  post) 
Observers.  Elevation  appeared  to  have  a  greater  effect  on  performance  than 
did  azimuth.  Freitag  (1974)  studied  simulated  sun  angles  of  0,  90,  and  180 
degrees  on  the  AMRL  1000:1  terrain  model  simulator.  He  reported  no  signi¬ 
ficant  main  effects  for  sun  angle  as  a  function  of  slant  range  or  time  of 
search.  However,  the  interaction  of  the  90-degree  sun  with  hilly  terrain 
significantly  reduced  slant  range  and  increased  search  time  when  compared 
with  the  0  and  180  degrees  case. 

c.  Sun  Elevation 

No  experimental  studies  on  the  effects  of  measured  sun 
elevation  on  air-to-ground  target  acquisition  are  reported  in  the  open 
literature. 

3.0  Observer-Related  Variables 

a.  Training  as  Aviators 

In  a  simple  laboratory  search  task  Erickson  (1965)  reported 
no  significant  performance  differences  between  high  school  boys  and  trained 
Naval  aviators.  In  a  simulator  study  using  TV,  King  and  Fowler  (1972)  re¬ 
ported  no  significant  differences  in  performance  between  college  students 
and  experienced  Navy  pilots.  However,  the  pilots  were  consistently  better. 

A  filmed  simulation  target  acquisition  study  also  found  no  difference  be¬ 
tween  experienced  pilots  and  non-pilots  (Russis,  et  al  1965). 

b.  Visual  Capability 


The  minimum  visual  requirements  for  military  aviators  are 
20/20  visual  acuity  (corrected)  and  no  visual  perception  of  color  anomalies. 
In  view  of  these  relatively  stringent  requirements,  no  serious  investi¬ 
gations  relating  visual  capability  to  target  acquisition  have  been  re¬ 
ported.  However,  a  recent  study  by  Williams  (1974)  indicates  the  spatial 
frequency  response  of  the  eye  may,  in  fact,  also  be  a  significant  contri¬ 
butor  to  visual  acuity. 


c.  Other 


Other  possible  Observer  variables  that  have  been  investi¬ 
gated  do  not  appear  to  significantly  affect  target  acquisition  visual 
search.  Within  the  range  of  ages  usually  involved  (21-45)  age  does  not 
make  a  difference  (Erickson  1964;  Erickson  1966;  Johnson,  1965).  Sex 
differences  do  not  affect  target  acquisition  performance  (King  and  Fowler, 
1972;  Parkes,  1972).  Nor  are  there  any  reported  difference  in  various 
tests  of  perceptual  capability  (Amundson,  Schlanta,  and  Sorenson,  1974) 
or  in  personality  measures  (See  1973  AGARD  TA  Symposium). 

4.0  Equipment-Related  Variables 

a.  Aircraft  Speed  and  Altitude 

_1  Within  the  range  of  typical  speeds  used  to  release 
most  tactical  ordnance  (200  to  600  knots)  there  is 
little  significant  effect  of  flight  speed  on  target 
acquisition.  This  typical  result  was  reported  by 
Valentine  (1972)  for  example,  where  in  field  tests, 
no  significant  differences  in  target  acquisition 
performance  were  found  between  a  300  knot  and  450 
knot  air  speed.  In  general  review  of  the  subject, 
Jones,  et  al,  conclude  that  "speed,  at  least  in  the 
regimes  of  typical  current  tactical  aircraft,  is  not 
a  significant  variable.  What  does  seem  important  is 
that  higher  speed  reduces  time  to  search"  (p  5-21) . 

2_  Altitude  -  The  most  commonly  found  experimental  result 
is  that  tactical  target  acquisition  performance  tends 
to  improve  almost  linearly  as  altitude  increases  up  to 
some  maximum  (Jones,  et  al,  1974).  The  slope  of  this 
curve  is  relatively  small,  however,  for  altitudes 
above  about  500  feet  (Blackwell,  Ohmart  and  Harcum, 
1960;  Valentine,  1972).  The  experimental  results 
are  entirely  predictable  on  the  basis  of  the  geometry, 
up  to  some  maximum  altitude,  above  which  the  target 
cannot  be  seen. 

b.  Use  of  Search  Aids 

The  most  commonly  reported  search  aid  is  detailed  pre¬ 
briefing.  Use  of  optical  sights  or  television  as  aids  to  direct  visual 
search  have  been  reported  in  two  controlled  experiments,  however. 

JL  Prebriefing  -  The  experimental  data  are  clear:  the 
more  detailed  the  prebriefing  the  better  the  target 
acquisition  performance  (Parkes,  1972b;  Russis  and 
Rawlings,  1966;  JTF-II,  Test  4.1,  1968).  These  re¬ 
ports  typically  were  concerned  with  types  of  briefing 
materials.  The  effect  of  relative  size  of  the  pre¬ 
briefed  search  areas  was  not  reported. 
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2_  Television  -  Almost  all  television  target  acquisition 
studies  have  used  TV  only,  not  as  an  aid  to  visual 
search.  Fowler  and  Jones  (1972),  however,  reported  on 
an  experiment  conducted  on  the  Martin  Marietta  terrain 
table  simulator  in  which  experienced  pilots  first  de¬ 
tected  the  scaled  60-foot  rectangular  targets  by  di¬ 
rect  vision  and  then  transitioned  to  a  television  dis¬ 
play  in  the  cockpit  for  acquisition.  Three  fields  of 
view  were  used.  Mean  range  of  acquisition  for  the  60- 
foot  target  was  5081  meters  with  a  4.8-degree  tele¬ 
vision  camera  field  of  view  (FOV),  3850  meters  with  a 
9.6-degree  FOV,  and  3114  meters  with  a  14.5-degree 
FOV. 

3  Stabilized  Optics  -  Cheever  and  Harley  conducted  a 

well-controlled  field  test  to  determine  target  identi¬ 
fication  capabilities  by  Observers  using  a  stabilized 
optics  system  (monocular)  with  up  to  20X  magnification, 
in  a  UH-1  helicopter.  The  aircraft  flew  at  2000  feet 
altitude  along  a  prescribed  course.  Targets  were 
marked  with  panels  so  that  acquisition  was  easy;  range 
of  identification  was  the  experimental  measure.  Thirty- 
two  percent  of  targets  were  identified  at  4000  meters. 

A  maximum  of  90  percent  were  identified  by  1000  meters. 

5.0  Terrain  Table  Simulation 

A  number  of  studies  have  used  terrain  tables  or  models  as  image 
source  materials  for  electro-optical  (EO)  sensors,  primarily  TV.  Other 
studies  are  system-specific  and  are  not  pertinent  to  this  experiment.  Ref¬ 
erence  and  review  to  most  can  be  found  in  Bliss  (1969)  and  Jones,  Freitag, 
and  Collyer  (1974). 

a.  Terrain  Table  Validation 

The  only  reported  air-to-ground  target  acquisition  study 
that  validates  terrain  table  simulation  with  a  related  field  test  is  that 
of  Blackwell,  Ohmart,  and  Harcum  (1959). 

Simulation  -  The  tests  were  conducted  by  moving  an 
electrically-driven  dolly  over  a  600:1  scale  terrain 
model  at  a  simulated  speed  of  130  knots  and  simulated 
altitudes  of  2000,  4000,  4500,  and  7000  feet.  The 
terrain  model  represented  one  square  nautical  mile  of 
ground.  Sunlight  was  simulated  with  a  5000  watt  in¬ 
candescent  lamp  in  a  60- inch  reflector.  Sun  angles, 
relative  to  the  Observer,  were  3,  45,  90,  122,  and 
177  degrees  at  an  elevation  of  45  degrees.  The  targets 
were  three  vehicles  in  line:  jeep,  1/2-ton  panel 
truck,  and  2-1/2  ton  truck.  Observers  were  nine  Naval 
Reserve  pilots.  A  total  of  840  runs  were  made  on  the 
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terrain  model,  with  10  possible  target  positions  on  the 
model.  Many  runs  were  made  by  each  Observer  against 
these  same  targets,  with  the  targets  at  a  different 
position  each  time.  The  positions  were  known  to  the 
Observers  and  were  not  used  more  than  once  per  Observer, 
thus  allowing  the  Observers  to  use  a  process  of  elimi¬ 
nation  on  the  target  positions  as  the  test  proceeded. 

2^  Flight  Test  Validation  -  A  total  of  109  flight  passes 
were  conducted  against  the  real  targets  of  which  the 
models  were  a  simulation.  The  targets  were  located  in 
a  one  square  nautical  mile  area  of  which  the  terrain 
model  was  a  generally  faithful  simulation.  As  in  the 
simulation,  the  three  stationary  targets  were  always 
grouped  as  an  in-line  convoy.  The  acquisition  task 
consisted  of  the  pilot’s  stating  the  heading  of  the 
convoy  and  the  order  of  the  vehicles.  Slant  range  at 
this  point  was  measured. 

J3  Results  -  There  were  significant  differences  between 
simulator  and  flight  trials,  although  the  trends  were 
the  same.  Averaged  over  all  passes,  the  overall  ac¬ 
quisition  probability  from  the  simulated  experiment 
was  0.89,  with  a  mean  range  of  4891  meters,  whereas 
under  field  conditions,  acquisition  probability  was 
0.60  with  a  mean  range  of  3403  meters.  Large  subject 
variability  occurred  from  trial  to  trial  in  both  test 
situations.  The  simulator  acquisition  probability 
and  range  data  tended  to  be  about  30  to  40  percent 
better  than  the  field  test  data. 

Other  Pertinent  Research 

1.  A  1000:1  terrain  table  simulation  was  conducted  at  the 
Aerospace  Medical  Laboratory  (AMRL)  as  the  SEEKVAL  IA1 
test  series  (Van  Ardsall,  1974).  A  series  of  three 
experiments  were  conducted.  The  first  examined  the 
effects  of  number  of  targets  (1,  3,  and  9  tanks)  and 
clutter  on  dynamic  (Observer  moving)  acquisition  per¬ 
formance;  the  second  addressed  the  effects  of  the  same 
factor  on  static  (Observer  stationary)  acquisition 
performance;  and  the  third  examined  the  effects  of 
variations  in  color  and  brightness  contrast  on  acquisi¬ 
tion  performance.  In  dynamic  situations  the  Observer 
"flew"  by  the  target  at  simulated  3500  feet  altitude  at 
a  speed  of  300  knots  at  a  minimum  range  of  approximately 
2200  meters.  In  the  static  experiment  the  Observer  was 
uncovered  at  several  altitudes  from  583  to  3500  feet. 
Target  to  background  contrasts  of  -0.20  and  -0.60  were 
used.  In  both  the  dynamic  and  static  modes,  the  effects 
of  number  of  targets  were  more  important  than  those  of 


clutter  on  detection  performance;  there  were  no  signi¬ 
ficant  effects  due  to  interaction  between  targets  and 
clutter  elements.  Effects  on  target  acquisition  due  to 
color  and  brightness  contrast  were  each  statistically 
significant;  however,  interaction  effects  between  these 
two  factors  were  not  statistically  significant.  For 
the  same  absolute  brightness  contrast,  targets  darker 
than  their  background  were  more  difficult  to  detect 
than  targets  lighter  than  their  background.  Overall, 
the  rate  of  correct  target  acquisition  was  about 
40  percent. 

Using  the  same  AMRL  terrain  table,  Freitag  (1974)  in¬ 
vestigated  effects  on  0,  90,  and  180  degrees  sun  angles 
(at  an  initial  elevation  of  about  40  degrees)  on  tar¬ 
get  (tank)  acquisitions  in  hilly  and  flat  terrain. 

Thirty  subjects  were  used  to  view  two  targets  each  in 
a  static  search  situation.  The  sun  was  simulated  by 
use  of  a  5000  watt  floodlamp.  Each  subject  started 
at  8500  feet  slant  range  at  3500  feet  altitude  and  was 
allowed  a  30-second  search  time.  If  the  target  was  not 
found  the  subject  was  moved  in  500  feet  and  the  trial 
repeated.  The  results  of  the  tests  indicated  no  over¬ 
all  significant  difference  for  sun  angle  on  either 
slant  range  or  search  time.  However,  for  the  hilly 
portion  of  the  terrain,  the  90  degree  sun  angle  had 
a  significantly  shorter  slant  range  and  required  signi¬ 
ficantly  more  search  time  t-han  did  the  0  and  180  degrees 
sun  angle. 


APPENDIX  D 


GENERAL  EXPERIMENTAL  PROCEDURES 


1.0  Observers 

a.  Selection 

Trained  military  aviators  were  provided  by  the  SEEKVAL 
Joint  Test  Director.  Sub-experiments  1,  2,  and  3  required  military  Observers 
trained  in  fixed-wing  aircraft.  These  were  supplied  by  the  Air  Force,  Navy, 
and  Marines.  Sub-experiments  4  and  5  required  military  Observers  trained  in 
helicopters.  These  were  supplied  by  the  Army  and  Marines. 

Untrained  Observers  were  supplied  by  Martin  Marietta  for 
sub-experiments  1  through  5.  To  eliminate  unmotivated  or  otherwise  unsuit¬ 
able  subjects,  all  Martin  Marietta  candidates  were  informed  of  the  SEEKVAL 
program  objective,  general  testing  concepts,  and  expected  individual  per¬ 
formance  requirements  before  volunteering.  All  untrained  Observers  were 
unskilled  in  target  acquisition  techniques,  and  had  no  current  military 
flight  experience. 


The  untrained  Observers  matched  the  trained  Observers  in 
numbers  so  that  identical  tests  could  be  run,  one  by  a  trained  and  one  by 
an  untrained  Observer. 

b.  Handling 

All  Observers  reported  to  the  briefing  room  and  were  given 
a  folder  which  contained  general  information  about  the  experiment  and  a 
subject  questionnaire  to  be  completed  on  personal  history,  such  as  age  and 
flight  experience. ^  A  vision  test  followed,  with  visual  acuity  as  well  as 
color  vision  tested  using  a  Bausch  &  Lomb  Orthorater.  Martin  Marietta 
personnel  who  failed  to  achieve  20/20  vision,  corrected  in  both  eyes,  and 
full  color  vision  were  excluded  from  further  participation  in  the  program. 
Visual  status  for  all  Observers  was  recorded  on  their  subject  questionnaires. 
A  few  untrained  Observers  were  used  who  had  marginal  20/20  vision  or  who  had 
slight  color  vision  deficiency.  A  subject  number  was  assigned  to  each  Ob¬ 
server  which  included,  as  a  suffix,  his  visual  status  (see  Appendix  G) . 

After  screening,  all  Observers  viewed  a  color  videotaped  briefing,  designed 
to  provide  all  Observers  with  a  standardized  level  of  knowledge  about  the 
optical  laboratory,  terrain  table  layout,  simulated  cockpit  (habitat),  and 
general  test  procedures,  and  to  assure  that  all  Observers  knew  what  to  ex¬ 
pect  during  the  experimental  trials. 


See  Appendices  I  and  J  for  materials  used  in  briefing  and  debriefing. 


After  viewing  the  tape,  the  Observers  were  given  a  target 
area  briefing  and  shown  a  map  representative  of  the  terrain  model,  marked 
with  the  six  (or  four)  separate  target  areas.  The  subjects  were  also  shown 
an  oblique  photograph  of  the  terrain  model,  taken  from  the  cockpit,  at  the 
approximate  angle  at  which  the  Observer  would  see  the  terrain,  and  close-up 
oblique  photographs  of  the  six  target  areas.  No  actual  targets  were  included 
on  these  photographs. 

A  search  method  was  assigned  to  each  Observer,  followed  by 
a  practical  familiarization  in  a  mock-up  of  the  actual  cockpit,  the  equip¬ 
ment,  and  controls  to  be  used  by  the  Observer  during  the  test  runs. 

The  Observers  were  then  transferred  from  the  briefing  room 
to  the  holding  room  to  wait  their  turn  for  the  test  runs. 

The  Experimenters  escorted  the  Observers  to  the  optical 
laboratory  and  into  the  cockpit,  and  again  checked  out  the  Observer  as  to 
the  specific  test  procedures  and  the  operation  of  controls  and  displays. 

For  the  test  runs,  the  Observer  carried  a  copy  of  the 
oblique  photograph  of  the  terrain,  with  the  six  target  areas  identified,  to 
be  used  as  a  mission  briefing  and  acquisition  debriefing  reference  during 
each  run. 

Upon  completion  of  the  run-set,  the  Experimenter  escorted 
the  Observer  to  the  debriefing  room.  There  the  Observer  filled  out  a  de¬ 
briefing  questionnaire  and  was  asked  to  avoid  detailed  discussion  of  the 
experiment  with  other  potential  Observers.  The  Observer  was  then  dismissed. 

2.0  Data  Recording  and  Handling 

a.  Data  Recording 

In  order  to  assure  "data  security,"  redundant  data  paths 
were  established  for  the  IB1  experiments.  For  initial  data  recording,  the 
redundancy  was  implemented  by  having  the  Experimenter  manually  fill  in  the 
Experimenter's  check  sheet  and  manual  log  form  (sea  Appendix  F)  and  by  re¬ 
quiring  him  to  key-in  the  data  using  the  Xerox  BC200  data  terminal  equipment 
mounted  in  the  Experimenter's  station.  A  14-inch  studio  monitor  provided 
a  readout  for  the  Experimenter,  identified  the  a  priori  run-set  parameters, 
and  provided  cues  for  the  Experimenter  so  that  the  proper  data  were  keyed 
in  when  required. 

At  the  beginning  of  a  run-set,  the  monitor  displayed  a 
request  for  run-set  number;  when  the  Experimenter  keyed  in  the  desired 
number,  the  a  priori  run-set  requirements,  as  previously  input  to  the  digital 
computer  test  plan,  were  displayed  on  the  monitor  and  on  the  repeater  at  the 
analog  computer  operator's  station.  The  monitor  display  then  called  for 
the  Observer's  serial  number.  This  number,  which  had  been  obtained  from  the 
briefer  and  had  been  entered  in  the  manual  log,  was  then  keyed  in  and  dis¬ 
played.  The  display  then  requested  the  Experimenter's  name  and  the  decimal 


number  (the  target  number  of  the  first  run).  When  these  had  been  supplied 
by  the  Experimenter,  the  display  announced  that  the  computer  was  ready  for 
the  runs  to  start. 

At  this  stage,  all  the  data  except  the  acquisition  data 
were  on  display  and  were  stored  by  the  computer.  It  appeared  as  shown  in 
Appendix  F  display  "a,"  except  that  the  encircled  acquisition  data  had  not 
yet  been  provided.  The  start  and  stop  signals  for  the  run  initiated  the 
sequences  that  provided  range  and  time  (or  time  only  for  the  helicopter 
runs)  data.  These  were  shown  on  the  displays  as  acquisition  data  and  were 
recorded  for  the  digital  print-out. 

Immediately  following  each  run,  the  Observer  was  debriefed 
by  the  Experimenter,  the  number  of  good  and  bad  targets  was  assessed,  and 
a  remarks  code  (see  Appendix  F)  selected.  These  additional  data  were  entered 
in  the  Experimenter's  check  sheet  and  manual  log,  and  were  keyed  into  the 
BC200,  going  to  the  displays  and  to  the  digital  computer  print-out.  This 
completed  the  initial  data  recording  function  for  each  run.  Multiple  cross 
checks  and  verifications  were  used  to  provide  the  level  of  data  credibility 
required. 

b.  Data  Handling  and  Verification 

At  the  end  of  each  run  the  analog  computer  operator  manually 
entered  the  Observer's  serial  number,  the  Experimenter's  name,  the  acqui¬ 
sition  data,  and  the  "remarks"  code  on  a  FORTRAN  loading  form;  the  a  priori 
data  for  each  run  set  had  been  previously  entered.  Also,  at  the  end  of 
each  run,  the  analog  computer  operator  annotated  the  analog  strip  charts  so 
that  a  backup  measurement  of  range  and  time  was  available. 

At  least  once  every  running  day,  all  Experimenter's  manual 
logs  were  checked  against  the  FORTRAN  loading  form.  If  a  discrepancy  was 
discovered,  the  digital  printout  and  the  annotated  analog  strip  chart  were 
consulted,  if  necessary,  and  resolution  was  obtained.  From  the  FORTRAN 
loading  form,  card  decks  were  punched  and  used  to  provide  several  printouts 
which  formed  the  basis  for  data  analysis. 

The  first  step  in  the  preli  linary  data  analysis  provided 
yet  another  data  check.  For  each  terrain  table  configuration,  a  matrix  of 
acquisition  data  was  prepared  manually.  These  matrices  provided  a  quick- 
look  at  result  trends  and  in  addition  any  occurrence  of  duplication  in  param¬ 
eters  or  the  existence  of  any  blanks  in  the  matrix  values  identified  an 
error.  These  were  few,  but  in  each  case,  the  alternative  data  sources  were 
investigated,  resolution  obtained,  and  cards  and  tab  runs  corrected. 

c.  Data  Procedural  Variations 

Because  of  the  variation  in  inputs  and  data  among  the 
several  experiments,  the  detailed  data  procedure  had  to  be  altered  from  ex¬ 
periment  to  experiment.  These  alterations  are  identified  in  the  section 
pertaining  to  the  individual  experiments. 


d.  Record  Photographs 

Record  photographs  were  taken  of  each  table  configuration 

as  follows: 

1^  Color  -  Oblique  view  of  each  target  area 

1_  Color  -  Closeup  (near  vertical)  of  each  target  array 

_3  Black  and  White  -  Oblique  view  of  each  target  array 

Color  photographs  for  terrain  table  configurations  A 
through  J  (sub-experiments  1-4)  were  taken  without  internal  color  refer¬ 
ence  since  they  were  intended  only  to  convey  the  general  appearance  of  the 
terrain  mode.  For  sub-experiment  5  (terrain  table  configurations  K  -  N) , 
however,  where  color  was  a  controlled  variable,  the  gray  scale  target,  a 
calibrated  Kodak  14- inch  gray  scale  modified  to  incorporate  two  gray  spheres 
and  identifying  data,  is  present  in  the  closeup  photographs. 

The  black  and  white  photographs  were  taken  at  a  slant 
range  of  12,000  feet  (scaled)  for  table  configurations  A  through  F  (sub¬ 
experiments  1-3)  and  2850  meters  (scaled)  for  table  configurations  G 
through  N  (sub-experiments  4  and  5).  Altitudes  were  3000  feet  (scaled) 
for  table  configurations  A  through  F  and  1300  feet  (scaled)  for  table 
configurations  G  through  N. 

A  Petri  35  mm  SLR  camera  with  a  300  mm,  f/6.9  telephoto 
lens  was  used  for  terrain  table  configurations  A  through  G  black  and  white 
photos.  Due  to  mechanical  damage  to  the  Petri,  a  Nikon  35  mm  SLR  with  a 
200  mm  f/4  telephoto  lens  was  used  for  Tables  H  through  N.  The  Petri  photo¬ 
graphs  were  taken  at  f/6.9,  1/2  second;  and  the  Nikon  photographs  were  taken 
at  f/5.6,  1/2  second.  Panatomic-X  film  was  used  in  all  cases;  normal  D-76 
developer  was  used. 

3.0  Methods  of  Analysis 

a.  General  Methodology 

The  primary  statistical  technique  used  for  analysis  of  the 
data  was  Analysis  of  Variance  (AN0VA) .  The  experimental  designs  were  gen¬ 
erally  characterized  by  the  fact  that  each  Observer  received  all  levels  of 
one  factor  (clutter/contrast),  and  only  one  level  of  the  remaining  factors. 
Winer  (1972) ^  used  the  designation  "multifactor  experiments  having  repeated 
measures"  for  this  class  of  design.  Because  of  a  large  amount  of  missing 


G.J.  Winer,  "Statistical  Principles  in  Experimental  Design,"  2nd  Ed., 
New  York:  McGraw-Hill,  1972. 
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data  (due  to  missed  acquisitions),  especially  in  sub-experiments  1,  2,  and 
3,  the  General  Linear  Model  (GLM)  run  as  the  BMD10V  program  of  the  Bio¬ 
medical  Computer  Programs  package  was  used  to  generate  missing  values. 
Non-parametric  methods,  primarily  chi-square,  were  used  to  analyze  the  data 
where  only  number  of  acquisitions  was  the  proper  variable  of  concern  (Siegel, 
19562). 

Cumulative  probability  of  acquisition  was  also  plotted  for 
a  variety  of  conditions.  No  statistical  test  of  these  distributions  was 
conducted.  In  all  cases,  the  .05  level  of  significance  was  chosen  as 
critical. 

b.  Non-Parametrics 

Whenever  measured  values  could  not  be  used  in  the  GLM  ANOVA 
(e.g.,  in  sub-experiment  2)  a  non-parametric  statistic  was  used.  The  ap¬ 
propriate  statistic  was,  in  nearly  all  cases,  chi-square.  For  sub-experiments 
4  and  5  a  test  difference  between  medians  (Siegel,  p  179-184)  was  used  for 
some  comparisons.  Any  evaluations  of  numbers  of  targets  acquired,  as  dif¬ 
fering  from  range  or  time  of  acquisition,  was  conducted  using  chi-square. 


c.  Analysis  of  Variance 

An  analysis  of  variance  was  used  to  test  for  statistical 
significance  of  the  various  factors  when  the  measured  response  was  detection 
range  or  detection  time.  For  analysis  purposes  it  was  assumed  that  all 
factors,  except  Observers  which  were  randomly  selected,  were  fixed  effects. 
In  all  of  the  experiments  there  was  a  significant  amount  of  missing  data; 
that  is,  the  Observer  failed  to  acquire  the  target.  The  fixed  wing  ex¬ 
periments  averaged  about  40  percent  acquisitions  and  the  rotary  wing 
experiments  averaged  about  90  percent  acquisitions. 


Because  of  the  large  amount  of  missing  data,  standard  tech¬ 
niques  could  not  be  used  to  perform  the  ANOVA.  Therefore,  the  GLM  was  used. 

A  Biomedical  Computer  Program,  BMD10V,  was  used  to  estimate  the  parameters 
and  test  the  hypotheses  concerning  a  general  linear  model.  While  BMD10V  will 
accommodate  missing  data,  it  does  have  some  disadvantages.  The  number  of 
parameters,  i.e.,  the  number  of  dummy  variables  the  analysis  of  variance 
generated,  which  could  be  included  in  the  model  was  le-.s  than  80.  For  most 
of  the  experiments  only  the  main  effects  and  the  two-way  interactions  could 
be  included  in  the  model.  Also,  because  of  missing  data,  the  number  of 
parameters  estimatable  was  further  reduced.  If  the  missing  data  was  not 
random,  but  correlated  to  one  of  the  variables,  the  program  gave  erroneous 
results.  In  fact,  the  medium  and  high  clutter  conditions  had  significantly 
fewer  data  points.  Therefore,  these  results  must  be  viewed  with  some 
caution. 


S.  Siegel,  "Non-parametric  Statistics  for  the  Behavioral  Sciences," 
New  York,  McGraw-Hill,  1956. 
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In  sub-experiments  1,  2,  and  3,  the  distribution  of  range 
of  detection  was  approximately  normal;  therefore,  no  transformations  were 
used.  However,  in  sub-experiments  4  and  5,  the  distribution  of  time  of 
detection  was  highly  skewed.  In  analyzing  these  experiments  a  logarithmic 
transformation  was  used.  A  transformed  value  of  X'  =  log  (X  +  1)  was  used 
and  results  in  a  distribution  which  was  approximately  normal. 


APPENDIX  E 


DETAILED  OPERATING  PROCEDURES 

SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-1 
READY  ROOM  BRIEFING 

1.  Open  Ready  Room  at  0730.  Turn  on  TV  to  warm  up. 

2.  Pick  up  Observers  at  GDC  gate.  Escort  to  Ready  Room. 

3.  Hand  to  all  Observers  SVIB1-1A  or  SVIB1-1B  Ready  Room  Briefing  Folder. 

4.  Answer  any  questions  to  best  of  your  ability. 

5.  Have  all  Observers  fill  out  questionnaire  and  background  information 
data. 

6.  Assign  each  Observer  a  serial  and  run  number.  Record  the  numbers  on 
the  daily  log  and  on  all  forms  pertaining  to  that  Observer:  ques¬ 
tionnaire,  vision  test,  etc. 

7.  Give  each  Observer  the  vision  test  (glasses  are  permitted)  on  both 
the  orthorater  and  the  selected  color  cards.  Record  test  results  on 
the  Observer's  records  and  assign  the  correct  suffix  to  the  Observer 
serial  number. 

NOTE:  (a)  Regardless  of  test  results  all  military  Observers  will 

complete  the  test  series. 

(b)  If  a  Martin  Marietta  Observer  fails  the  eye  examination 
he  will  be  excused  from  further  participation. 

CRITERIA:  Vision  no  less  than  20:20  corrected  with 
glasses.  No  color  anomalies  on  the  color 
plates . 

(c)  If  an  Observer  must  wear  glasses  to  achieve  the  required 
vision  level,  note  this  on  the  record  so  that  the  Experi¬ 
menter  can  require  it  on  test  runs. 

8.  Show  all  Observers  the  SEEKVAL  TV  briefing  tape. 

9.  Conduct  mission  briefing. 

10.  Use  mockup  to  demonstrate  how  the  equipment  on  the  cockpit  simulator 
works.  Assign  search  methods. 
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11.  All  Observers  are  transferred  to  the  Holding  Room  after  they  have  been 
briefed  and  must  remain  there  until  their  turn  is  scheduled.  When 
ready,  a  test  Experimenter  will  pick  them  up.  Caution  all  Observers 
that  after  the  test  is  run  they  will  not  be  allowed  in  the  Ready  Room. 
Any  personal  gear  left  in  the  Ready  Room  during  the  experimental  run 
can  be  picked  up  while  the  Observer  is  escorted  after  the  test  run. 

NOTE:  Do  not  allow  discussion  between  new  and  old  Observers  at  this 
time.  All  Observers  will  leave  the  GDC  area  immediately  after 
the  test. 

12.  Information  and  help  about  travel  reservations,  etc.,  can  be  made 
through  R&T  Marketing:  Call  X4404  or  4564.  Let  the  Military  subjects 
make  those  arrangements  if  needed. 

NOTE:  Briefing  materials  associated  with  this  procedure  may  be  found 
in  Appendices  I  and  J. 


SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-2 
MISSION  BRIEFING 


1.  Pick  up  Observer  at  Holding  Room.  Get  his  name  and  subject  number  from 
briefer. 

2.  Verify  search  method  to  be  used  with  briefer,  direct  vision  or  visual 
aid  (copy  attached).  Make  sure  that  your  instructions  are  correct  and 
match  the  type  of  experiment  being  conducted. 

3.  Assure  that  Observer  is  completely  familiar  with  cockpit  and  procedures 
to  expect  in  the  test  run. 

4.  Assure  that  all  Observers  have  seen  and  are  familiar  with  the  terrain 
map  and  aerial  photograph. 

NOTE:  All  Observers  should  be  at  an  equal  knowledge  level  and  have 
read  the  target  acquisition  instructions. 

5.  Answer  any  questions  to  the  best  of  your  ability. 

6.  Escort  Observers  to  Optical  Laboratory.  Enter  by  the  southwest  door. 

7.  Check  that  Optical  Laboratory  is  set  up  and  ready.  Escort  Observer 
into  habitat.  Caution  Observer  not  to  look  at  terrain  table.  Walk 
on  Observer's  left  to  effectively  screen  his  view  of  terrain  table. 


SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-3 
HABITAT  BOARDING 


1.  Prior  to  introducing  the  Observer  to  the  optical  room  for  cockpit 
boarding,  the  following  conditions  will  exist: 

a.  Sun  Simulator  positioned  and  on  if  required. 

b.  Terrain  model  reset  to  north  end  and  lab  in  hold. 

c.  Cockpit  at  floor  level  with  vertical  beam  drive  turned  off  and 
vision  mask  in  place  (helicopter  runs) . 

d.  Observer  briefed  for  mission. 

2.  Experimenter  will  escort  the  Observer  to  the  cockpit,  requesting  that 
he  not  look  at  the  terrain  model. 

3.  Observer  enter  habitat.  Experimenter  point  out  low  head  clearance. 
Experimenter  assist  with  strapping  in  as  required. 

4.  Observer  should  don  helmet  and  adjust  the  helmet  sight  as  required. 

5.  Experimenter  assist  with  seat  adjustment  for  correct  eye  position  and 
comfort. 

6.  Boresight  helmet  sight  (if  applicable). 

7.  Experimenter  brief  Observer  on  location  and  function  of  needed  controls 
and  refresh  his  memory  on  what  he  will  be  doing. 

8.  Allow  the  Observer  several  practice  sessions  with  the  controls  that  he 
will  use.  All  Observers  should  be  familiar  with  and  be  able  to  operate 
the  controls  before  test  run  starts. 

9.  Give  run  briefing. 

10.  Experimenter  board  his  station,  strap  in,  and  don  head  set.  Close  the 
curtain  in  front  of  the  Observer. 

11.  Experimenter  check  communications  with  test  conductor  and  Observer. 

12.  Experimenter  check  monitor  test  parameter  display  against  Experimenter 
Check  Sheet  and  visually  verify  lab  setup. 

13.  Energize  vertical  drive  on  Experimenter's  command  and  position  cockpit 
vertically. 

14.  Vertical  drive  off. 
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15.  Lateral  drive  on  at  Experimenter’s  command  and  position  cockpit  later¬ 
ally. 

16.  Lateral  drive  off. 

17.  Experimenter  enter  Observer’s  identification  number  into  computer. 

18.  Verify  that  computer  and  your  written  log  are  both  the  same  for  the 
run. 

19.  Ensure  Observer  can  distinguish  the  target  area  boundaries  and  identify 
a  narrow  area  of  search  within  the  area.  Begin  run. 

20.  Verify  each  target  location  by  requesting  verbal  description  of  target 
and  target  area.  Record  results  on  Experimenter's  Check  Sheet  and  in 
computer . 


SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-4 
RUN  BRIEFING 


1.  Assure  Observer  is  in  cockpit,  helmet  sight  positioned,  and  Observer  is 
familiar  with  all  required  controls. 

2.  Read  run  briefing  for  each  of  the  several  targets  in  turn. 

3.  Verify  each  target  location  by  requesting  verbal  description  of  target 
and  target  areas,  and  check  with  target  oblique  photo  if  necessary. 
Record  results  on  evaluation  sheet  and  on  computer. 

4.  Repeat  2  and  3  for  each  run. 
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SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-5 
RUN 

1.  Prior  to  executing  this  procedure,  the  mission  and  specific  run  briefing 
shall  have  been  completed. 

2.  Experimenter  verify  lab  and  Observer  ready  and  signal  via  his  keyboard. 

3.  Experimenter  start  run  by  depressing  START  button. 

4.  Experimenter  check  curtain  up,  model  in  motion  (if  applicable)  and 
Observer's  display  active  if  applicable. 

5.  Experimenter  watch  Observer  and  make  notes  of  exceptional  behavior. 

6.  NOTE:  If  Observer  has  not  found  target  by  time  the  target  area  is  out 

of  field  of  view,  push  curtain  down  to  end  run.  Record  as  no 
target  found. 

7.  At  run  end.  Experimenter  note  curtain  down,  debrief  subject,  and  note 
results  on  computer  printout.  Reset  as  applicable  and  enter  results 
via  keyboard  and  record  on  the  Manual  Log.  After  pressing  SEND,  verify 
correct  information  transmitted.  Experimenter's  log  and  computer 
should  be  redundant  copies  of  the  run. 

8.  Brief  next  run  and  return  to  step  2;  if  Observer  has  completed  his 
mission  proceed  to  Habitat  Disembarking,  Procedure  SVIB1-7. 


SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-6 
SOLAR  SIMULATOR  POSITIONING 

1.  Prior  to  executing  this  procedure,  the  following  conditions  will  exist: 

a.  Terrain  model  positioned  near  center  of  lab  and  lab  in  hold  condi¬ 
tion. 

b.  Boom  lowered  and  retracted  and  positioned  along  vehicle  longitudinal 
axis. 

2.  Uncouple  from  the  terrain  model  and  retract  coupling  arms. 

3.  Drive  simulator  to  new  position  using  caution  to  avoid  running  over  or 
snagging  lamp  power  cable. 

4.  Couple  to  terrain  model  and  check  attachments. 

5.  Position  boom  to  required  elevation,  azimuth  and  extension.  When  under 
balcony,  use  care  to  avoid  hitting  lights  or  balcony  structure. 

6.  With  lamp  on,  adjust  tilt/pan  to  illuminate  the  proper  area. 
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SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-7 
HABITAT  DISEMBARKING 

1.  Prior  to  proceeding  with  this  procedure,  the  terrain  model  will  be  reset 
to  the  north  end  and  lab  placed  in  hold. 

2.  Lower  habitat  to  floor  level  ensuring  that  it  is  laterally  positioned 
so  that  Observer  can  disembark  well  clear  of  trenches.  Turn  vertical 
drive  off. 

3.  Experimenter  exit  his  station  and  assist  Observer  in  removing  helmet 
and  to  disembark. 

4.  Experimenter  escort  Observer  to  Debriefing  Room  and  debrief. 
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SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-8 
MISSION  DEBRIEFING 

1.  Experimenter  read  debriefing  material. 

2.  Have  Observer  complete  the  debriefing  questionnaire. 

3.  Escort  Observer  to  gate  or  leave  in  debriefing  area  at  his  option. 

4.  Ensure  no  contact  with  other  Observers  until  their  run  sets  are  complete. 
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SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-9 
DAILY  LABORATORY  VERIFICATION 

NOTE:  Steps  1  through  11  apply  to  fixed  wing  sub-experiments  1,  2,  and 
3  only. 

1.  Turn  on  television,  2-axis  gimbal,  and  helmet  sight  equipment. 

2.  Verify  terrain  model  velocity  of  0.89  feet/second. 

3.  Check  reset  position  of  terrain  model  at  north  end  of  lab. 

4.  Check  cockpit  initial  lateral  positions. 

5.  Check  cockpit  altitude  above  the  floor. 

6.  Measure  and  record  overhead  lighting  level  at  the  terrain  model  surface 
directly  under  the  overhead  hoist  under  two  conditions: 

a.  high  level  (overcast  sky)  500  foot-candles  approx. 

b.  low  level  (skylight)  100  foot-candles  approx. 

7.  Position  solar  simulator  for  first  run  of  the  day,  turn  on,  allow  to 
stabilize  (approx.  5  minutes)  and  measure  near  center  of  beam  at  terrain 
model  surface.  Reading  should  be  approximately  500  foot-candles. 

8.  Compare  reading  taken  under  6b.  with  7.  If  6b.  is  not  approximately 
20  percent  of  7,  proceed  in  accordance  with  Procedure  SVIB1-17,  Light¬ 
ing  Adjustments. 

9.  Man  the  cockpit.  Experimenter's  station,  and  test  conductor's  station 
and  perform  the  following  checks: 

a.  Communications 

b.  Helmet  sight  boresight  and  gimbal  control 

c.  Transition  from  helmet  sight  to  track  stick  control 

d.  Autofocus 

e.  Observer's  display  quality 

f.  Data  entry,  transmission  and  recall 

g.  Experimenter's  control  functions 

h.  Test  conductor's  control  functions 
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i.  Observer’s  event  mark  function 

j.  Observer's  vision  mask  (curtain) 

k.  Zoom  control. 

10.  Set  up  annotated  video  tape  identification  board,  train  sensor  on  the 
board,  zoom  down  to  board  and  make  a  15  second  video  recording.  While 
recording,  read  board  aloud  over  Observer's  microphone.  Play  tape  back 
and  verify  video  and  audio  recording  quality.  Advance  tape  past  iden¬ 
tification  recording. 

11.  Inspect  terrain  model  for  setup  for  first  run  and  check  for  foreign 
objects.  If  necessary,  vacuum  or  sweep  open  areas. 

NOTE:  Steps  12  through  19  apply  to  experiments  4  and  5  only. 

12.  Turn  on  television,  2-axis  gimbal,  and  pantograph  equipment. 

13.  Check  cockpit  initial  lateral  positions. 

14.  Check  cockpit  altitude  above  floor  for: 

a.  800  foot  simulation 

b.  1300  foot  simulation 

c.  1800  foot  simulation  as  applicable  for  the  day's  runs. 

15.  Check  terrain  table  positions  for  three  standoff  ranges  from  four  tar¬ 
gets  as  applicable  for  day's  runs. 

16.  Measure  and  record  overhead  lighting  level  at  the  terrain  model  surface 
directly  under  the  overhead  hoist:  500  foot-candles  approx.  If  the 
level  is  incorrect,  proceed  in  accordance  with  Procedure  SVIB1-17, 
Lighting  Adjustments. 

17.  Man  the  cockpit.  Experimenter's  station,  and  test  conductor's  station 
and  perform  the  following  checks: 

a.  Communications 

b.  Pantograph  boresight  and  gimbal  control 

c.  Transition  from  pantograph  to  track  stick  control 

d.  Autofocus 

e.  Observer's  display  quality 

f.  Data  entry,  transmission,  and  recall 
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SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-10 
TABLE  CHANGES 

NOTE:  Steps  1  through  7  are  applicable  to  terrain  table  configurations 
A  through  J  only. 

1.  Review  requirements  for  the  next  table  configuration  per  Chart  SVIB1-10A 
and  determine  the  most  efficient  method  of  making  the  change,  e.g.,  in 
many  cases  the  target  array  in  a  particular  area  will  not  change. 

2.  Remove  target  and  clutter  elements  which  are  to  be  replaced. 

3.  Add  new  targets. 

4.  For  table  configurations  A  through  F,  add  new  clutter  so  that  no  tree 
is  closer  to  a  tank  than  2.8  times  the  tree  height  along  any  of  the 
possible  sun  bearings  and  no  closer  than  1.5  times  tree  height  in  any 
case.  This  will  assure  that  clutter  shadows  will  not  impinge  on  tanks. 
Also  ensure  that  trees  will  not  obscure  the  targets  from  the  Observer's 
eye  level  at  the  initial  position  viewing  angle. 

5.  For  table  configurations  G  through  J,  add  new  clutter  so  that  no  tree 
is  closer  to  a  tank  than  1.5  times  tree  height  and  that  no  tree  ob¬ 
scures  a  tank  from  any  initial  position. 

6.  Take  photometric  measurements  of  areas  with  new  target  tanks  per  Pro¬ 
cedure  SVIBl-11.  If  any  contrast  measurement  is  beyond  limits,  repaint 
targets  as  required. 

7.  Make  photographs  for  record  per  Procedure  SV1B1-12. 

NOTE:  Steps  8  through  15  are  applicable  to  terrain  table  configurations 
K  and  M  only. 

8.  Clear  all  target  areas  of  targets  and  clutter. 

9.  Apply  background  color  as  called  for  by  Chart  SVIB1-10A  to  all  target 
areas.  The  color  should  be  relatively  homogeneous  within  a  75  meter 
radius  of  the  surveyed  location  and  blending  gradually  into  the 
surroundings  beyond  that  range. 

10.  Insert  pattern  painted  tanks  in  all  four  areas.  These  tanks  must  be 
identified  and  reserved  for  later  use  in  the  same  positions. 

11.  Take  photometric  measurements  per  Procedure  SVIBl-11.  Adjust  back¬ 
ground  colors  as  required  to  achieve  -0.5  +  0.1  contrast. 
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12.  Replace  pattern  painted  tanks  with  OD  tanks  similarly  identified  and 
make  photometric  measurements.  Adjust  tank  colors  for  -0.5  +  0.1 
contrast. 

13.  Remove  OD  tanks  from  two  areas  and  substitute  dedicated  pattern  painted 
tanks  per  Chart  SVIB1-10A. 

14.  Add  clutter  elements  as  specified  in  Chart  SVIB1-10A  observing  the 
same  criteria  for  location  as  specified  in  Step  5. 

15.  Make  photographs  for  record  per  Procedure  SVIB1-12. 

NOTE:  Steps  16  through  18  are  applicable  to  terrain  table  configura¬ 
tions  L  and  N  only. 

16.  Remove  all  tanks  and  replace  with  dedicated  tanks  per  Chart  SVIB1-10A. 

17.  Take  photometric  measurements  of  all  areas  per  Procedure  SVIB1-11. 

18.  Make  photographs  for  record  per  Procedure  SVIB1-12. 


CHART  SVIB1-10A 

SEEKVAL  IB1  TARGET  AREA  DESCRIPTIONS 
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SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIBl-11 
PHOTOMETRIC  MEASUREMENTS 

NOTE:  This  procedure  will  be  accomplished  at  any  time  that  target  tanks 
are  changed  or  when  a  background  color  has  been  changed  in  a 
target  area. 

1.  Turn  on  full  overhead  fluorescent  lighting. 

2.  Position  terrain  model  south  of  the  center  of  the  lab. 

3.  Measure  the  light  level  in  foot-candles  at  the  terrain  model  surface. 

4.  Set  up  the  Pritchard  photometer  with  the  2  foot  aperture  for  800:1 
scale  (sub-experiments  1,  2,  and  3)  or  the  6-foot  aperture  for  200:1 
scale  (sub-experiments  4  and  5) .  Mount  the  photometer  on  the  habitat 
and  position  the  terrain  model  and  the  habitat  so  that  the  photometer 
head  is  3.75  feet  above  the  terrain  surface  at  a  15  foot  slant  range 
south  of  the  target  for  sub-experiments  1,  2,  and  3.  Sub-experiment 
4  and  5  use  6.5  feet  altitude  and  46.75  feet  slant  range. 

5.  Scan  each  tank  in  an  area  in  turn,  measuring  and  recording  the  average 
luminance  based  on  the  area  of  the  tank  visible  to  the  photometer.  Use 
Form  SBIBl-llA  for  recording. 

6.  Scan  the  terrain  model  surface  within  a  6  inch  radius  around  the  tank 
array  and  record  the  average  value. 

7.  Compute  contrast  of  each  tank/background  as  follows: 


c  =  TI (AVG)  BI(AVG) 

BI(AVG) 

where:  ^(avg)  =  Average  tank  illuminance 

BI(avg)  =  Average  background  illuminance 

For  sub -experiments  1  through  4,  contrast  must  equal  -0.2  to  -0.5  for 
low  contrast  areas  and  -0.6  to  -0.9  for  high  contrast  areas.  For  sub¬ 
experiment  5,  contrast  must  be  -0.5  ±  0.1.  In  the  event  of  discrepancy, 
see  Procedure  SVIB1-10. 
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FORM  SBIB1-11A 
PHOTOMETRIC  MEASUREMENTS 


Table 

Date 

By 

Luminance  Reading 

Target 

Tank 

Back¬ 

Negative  Contrast 

Ratio 

Area 

North  Center  South 

ground 

North  Center 

South 
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SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-12 
PHOTOGRAPHIC  RECORDING 

NOTE:  This  procedure  is  applicable  whenever  a  new  terrain  model  setup 
is  completed  and  normally  will  be  accomplished  prior  to  making 
runs.  Film  used  will  be  Kodacolor  II. 

1.  Position  terrain  model  with  south  end  near  habitat. 

2.  Turn  on  full  overhead  lighting. 

3.  Attach  tripod  to  front  of  habitat. 

4.  Station  photographer  in  habitat  and  position  habitat  and  terrain  model 
for  optimum  framing  of  six  or  four  target  areas  individually  and  photo¬ 
graph. 

5.  Position  cockpit  and  terrain  model  for  optimum  framing  of  entire  model 
surface  and  photograph  (optional  step). 

6.  Process  film,  make  two  8  x  10  color  prints  of  each  and  record  negative 
numbers. 

7.  Retain  prints  in  the  data  file. 
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SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-13 
DATA  HANDLING 

1.  Data  generated  in  the  course  of  these  experiments  will  take  the 
following  form. 

a.  Daily  run  schedule  and  log,  Form  SVIB1-16A 

b.  Photometric  measurements,  Form  SVIB1-11A 

c.  Record  photographs  of  target  areas  for  each  table  configuration 
(2  copies) 

d.  Observer  Audit 

e.  Observer  initial  testing  record  (2  copies) 

f.  Lighting  level  record,  Form  SVIB1-17A 

g.  Pre-run  computer  printout  (2  copies) 

Copy  1  -  Experimenter's  run  log 
Copy  2  -  Test  Conductor's  run  log 

h.  Post-run  computer  printout  (2  copies) 

i.  Data  cards  (2  sets) 

j .  Video  tapes 

k.  Master  experimental  log 

Handling  and  disposition  of  these  data  will  be  as  specified  in  the 
following  paragraphs. 

2.  DAILY  RUN  SCHEDULE  AND  LOG  -  This  form  will  be  prepared  each  after¬ 
noon  for  the  following  day's  runs.  It  will  be  used  to  generate  the 
two  copies  of  the  pre-run  computer  printout  (item  l.g.).  The  form 
will  be  retained  in  the  master  experimental  log  and  delivered  with  the 
final  report. 

3.  PHOTOMETRIC  MEASUREMENTS  -  This  form  will  be  prepared  for  each  unique 
table  configuration  and  as  required.  The  original  will  be  retained 
in  the  master  experimental  log  and  delivered  with  the  final  report. 

4.  RECORD  PHOTOGRAPHS  -  These  photographs  will  be  taken  of  each  unique 
table  configuration  and  as  required.  One  set  will  be  retained  in  the 
master  experimental  log  and  delivered  with  the  final  report.  One  set 
will  be  available  for  general  use. 
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5.  OBSERVER  AUDIT  -  One  copy  will  be  retained  in  the  master  experimental 
log  and  delivered  with  the  final  report. 

6.  OBSERVER  INITIAL  TESTING  RECORD  -  One  copy  will  be  retained  in  the 
master  experimental  log  and  delivered  with  the  final  report. 

7.  LIGHTING  LEVEL  RECORD  -  This  form  will  be  prepared  whenever  a  change 
in  lighting  level  occurs  and  will  be  retained  in  the  master  experi¬ 
mental  log  and  delivered  with  the  final  report. 

8.  PRE-RUN  COMPUTER  PRINTOUT  -  One  copy  will  be  used  by  the  Experimenter 
as  a  run  schedule.  A  second  copy  will  be  used  by  the  test  conductor  as 
a  run  schedule  and  as  a  log  for  recording  significant  events  or 
anomalies.  The  second  copy  will  be  retained  in  the  master  experimental 
log  and  delivered  with  the  final  report. 

9.  POST-RUN  COMPUTER  PRINTOUT  -  One  copy  will  be  used  as  the  source  for  key¬ 
punching  data  cards  (item  l.i.)  and  will  be  retained  in  the  control 

room  for  reference. 

10.  DATA  CARDS  -  These  cards  will  be  prepared  daily.  One  set  will  be 
retained  in  the  control  room  and  will  be  used  in  the  final  analysis 
process  and  delivered  with  the  final  report.  The  other  set  will  be 
delivered  daily  to  SEEKVAL  East. 

11.  VIDEO  TAPES  -  These  tapes,  recording  all  experimental  runs,  will  be 
retained  in  the  Martin  Marietta  program  office  and  delivered  with 
the  final  report. 

12.  MASTER  EXPERIMENTAL  LOG  -  This  log  will  be  retained  in  the  Martin 
Marietta  program  office  and  delivered  with  the  final  report. 


SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-14 
DEFINITIONS 

ACQUISITION  ATTEMPT  -  A  single  exposure  of  the  terrain  model  to  the  Observer 
for  the  purpose  of  target  detection  and  recognition. 

ALTITUDE  -  The  distance  from  the  Observer's  eye  level  to  the  mean  terrain 
model  elevation  plane. 

CLUTTER  -  Vegetation  within  a  200  meter  radius  of  a  surveyed  target  location 
which  could  be  mistaken  for  a  tank.  The  three  levels  of  clutter  used  in  this 
experiment  are  defined  as  follows: 

Low  -  No  clutter  within  200  meter  radius 

Medium  -  20  trees  or  shrubs  within  200  meter  radius 

High  -  60  trees  or  shrubs  within  200  meter  radius 

CLUTTER  AREA  -  A  200  meter  radius  circle  surrounding  the  surveyed  target 
location  which  contains  the  clutter  level  prescribed  by  the  test  plan. 

COCKPIT  -  Cockpit  simulator  which  is  Observer's  station.  Also  referred  to 
as  habitat. 

CONTRAST  -  The  difference  between  target  and  background  luminance  divided 
by  background  luminance,  i.e., 


For  all  experiments  except  5,  there  will  be  two  contrast  levels  used 

High  =  -0.6  to  -0.9 
Low  =  -0.2  to  -0.5 

CONTROL  ROOM  -  Area  west  of  optical  room  containing  primary  optical  room 
control  equipment  and  computer  complex. 

EXPERIMENTER  -  One  of  two  individuals  whose  function  in  to  accompany  and 
watch  Observers  during  their  experimental  part  icipat  ion.  He  is  also 
responsible  for  recording  and  entering  Observer's  data.  Also  may  be 
referred  to  as  umpire. 

EXPERIMENTER'S  STATION  -  Structure  mounted  next  to  the  cockpit  from  which 
the  experimenter  watches  the  Observer  and  performs  his  control  and  data  input 
functions. 
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HABITAT  -  Cockpit-like  structure  which  is  the  Observer's  station  for  his 
acquisition  attempts. 

HORIZONTAL  RANGE  -  The  horizontal  distance  from  a  vertical  line  through  the 
Observer's  eye  position  to  a  particular  location  on  the  terrain  model, 
usually  a  surveyed  target  location. 

MEAN  TERRAIN  MODEL  ELEVATION  (MTME)  -  Defines  a  horizontal  plane  through  the 
terrain  model  at  the  approximate  mean  of  the  elevations  of  the  six  surveyed 
target  locations.  All  altitude  measurements  are  referenced  to  the  MTME. 

MISSION  -  Group  of  all  target  acquisitions  or  runs  attempted  by  one  Observer. 
Normally  six  runs  in  experiments  1,  2,  and  3;  and  4  runs  in  experiments 
4  and  5. 

OBSERVER  -  Synonymous  with  subject. 

OPTICAL  ROOM  -  The  area  containing  the  terrain  model,  solar  simulator, 
habitat,  and  Experimenter's  station. 

RUN  -  Single  attempt  to  acquire  targets  in  a  given  target  area.  A  run 
commences  with  the  raising  of  the  subject's  curtain  and  ends  when  the 
curtain  is  lowered. 

RUN  SET  -  Synonymous  with  mission. 

SLANT  RANGE  -  The  diagonal  measurement  from  the  Observer's  eye  position  to 
a  particular  location  on  the  terrain  model,  usually  a  surveyed  target 
location. 

SOLAR  SIMULATOR  -  Mobile  xenon  lamp  capable  of  being  positioned  to  simulate 
various  sun  elevations  and  azimuths. 

SUBJECT  -  An  individual,  either  military  or  Martin  Marietta  employee, 
selected  to  participate  in  the  experiment  by  making  4  or  6  acquisition 
attempts  using  various  means  and  under  various  conditions.  May  be  referred 
to  as  an  Observer. 

SURVEYED  TARGET  LOCATION  (STL)  -  One  of  nine  discrete  points  on  the  terrain 
model  from  which  horizontal  range  measurements  are  made.  The  center  tank 
of  the  3-tank  arrays  will  be  positioned  at  these  locations.  In  sub-experi¬ 
ment  2,  the  center  tank  of  the  lead  element  in  the  9-tank  array  and  the 
single  tanks  will  be  placed  at  these  locations.  Sub-experiments  1,  2,  and 
3  use  six  STL  and  4  and  5  use  one  of  the  surveyed  locations  used  in  sub¬ 
experiments  1,  2,  and  3  plus  three  others. 

TARGET  -  In  sub-experiments  1,  3,  4,  and  5,  the  target  will  consist  of  three 
M60  tank  models  of  an  appropriate  scale  and  coloration,  arranged  along  a 
northeast-southwest  line  on  the  west  side  of  the  table  and  on  the  east  side, 
a  northwest-southeast  line  at  50  meter  intervals  and  oriented  as  if  pro¬ 
ceeding  to  the  southeast  on  the  west  side  of  the  table  and  southwest  on  the 
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other  side.  The  center  tank  of  the  formation  will  be  on  the  surveyed  target 
location  (STL).  In  sub-experiment  2,  the  target  will  consist  of  zero,  one, 
three  or  nine  tanks.  Single  tanks  and  the  center  of  the  three  tank  forma¬ 
tions  will  be  positioned  on  the  STL.  Nine-tank  formations  will  have  three 
three-tank  elements;  each  element  will  be  arranged  line  abreast  as  indicated 
above  and  the  three  elements  will  be  arranged  in  a  "V"  formation  with  the 
center  tank  of  the  lead  element  on  the  STL  and  the  inboard  tank  of  the  two 
rear  elements  positioned  50  meters  to  the  rear  and  50  meters  outboard  of  the 
outboard  tank  of  the  lead  element. 

TARGET  AREA  -  An  area  of  the  terrain  model  bounded  by  prebriefed  features 
which  define  the  area  to  be  searched  during  a  single  run.  In  sub-experiments 
1,  2,  and  3,  there  are  six  such  areas  numbered  from  south  to  north  and 
west  to  east: 
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Ill 

VI 

II 

V 

I 

IV 

S 

In  sub-experiments  4  and  5  there  are  four  areas,  also  numbered  south  to 
north  and  west  to  east: 


N 


II 

IV 

I 

III 

S 

TEST  CONDUCTOR  -  The  individual  with  overall  control  over  the  laboratory  by 
virtue  of  having  overriding  control  of  all  functions.  He  is  stationed  in 
the  control  room  and  maintains  visual  surveillance  of  the  optical  room. 


UMPIRE  -  Synonymous  with  Experimenter. 


SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-15 
SAFETY 

NOTE:  The  following  safety  procedures  are  mandatory  and  will  be 

followed  in  addition  to  those  prescribed  in  other  operating 
procedures.  A  copy  of  this  procedure  will  be  read  and  initialed 
by  all  personnel  involved  in  test  conduct. 

1.  The  safety  of  the  Experimental  Observers  will  be  paramount  in  the 
execution  of  the  experiments  and  in  interpretation  of  all  procedures. 

2.  During  runs,  all  doors  in  the  optical  room  except  the  overhead  door 
and  the  door  to  the  south  lobby  will  be  kept  locked.  The  terrain 
model  will  not  be  moved  until  the  test  conductor  has  verified  the 
doors  are  locked;  the  Experimenter  and  test  conductor  will  maintain 
surveillance  of  the  two  unlocked  doors. 

3.  The  overhead  door  will  be  raised  prior  to  moving  the  terrain  model  to 
a  height  just  sufficient  to  clear  the  highest  point  on  the  terrain 
model  as  indicated  by  the  index  mark  on  the  west  door  frame. 

4.  The  lateral  and  vertical  drive  systems  will  be  turned  on  only  while 
positioning  the  habitat,  and  only  one  drive  system  will  be  on  at  any 
given  time  whenever  habitat  and/or  Experimenter's  station  is  occupied. 

5.  The  beam  will  never  be  raised  from  the  floor  with  occupants  in  the 
cockpit  and  Experimenter's  station  unless  they  are  in  their  seats  with 
lap  belts  and  shoulder  harnesses  secured. 

6.  The  solar  simulator  vehicle  will  not  be  moved  nor  the  boom  controls 
actuated  unless  someone  is  stationed  to  watch  for  possible  hazards. 
Among  the  hazards  to  be  particularly  guarded  against  are: 

a.  Driving  solar  simulator  vehicle  into  trenches. 

b.  Contact  with  lights  or  laboratory  structure  by  any  part  of  the 
boom. 

c.  Running  over  or  snagging  lamp  power  cable. 

d.  Moving  boom  without  outrigger  or  transporter  attachment. 

7.  The  solar. simulator  vehicle  parking  brake  will: 

a.  Never  be  set  while  attached  to  the  terrain  model  transporter. 

b.  Always  be  set  when  unattended  and  not  attached  to  the  terrain 
model  transporter. 


E-25 


8.  When  attached  to  the  north  end  of  the  terrain  model,  the  solar  simulator 
boom  must  not  be  moved  in  azimuth  more  than  30  degrees  from  the  north- 
south  direction  unless  the  boom  is  fully  retracted. 
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SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-16 
RUN  SCHEDULING 

NOTE:  This  procedure  is  to  be  used  on  a  daily  basis  after  completion 
of  runs. 

1.  Review  completed  run  records  and  following  day's  Observer  input 
schedule. 

2.  Determine  optimum  lab  utilization  plan  for  the  day  and  list  desired 
runs  in  the  order  to  be  accomplished  on  Form  SVIB1-16A,  Daily  Run 
Schedule  and  Log. 

3.  Enter  desired  runs  in  computer  and  print  out  pre-run  sheets  in 
duplicate. 

4.  Place  the  original  in  the  Experimenter's  station  and  the  carbon  copy 
at  test  conductor's  station. 
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FORM  SVIB1-16A 
SEEKVAL  EXPERIMENT  IB1 
DAILY  RUN  SCHEDULE  AND  LOG 


Date 

Sheet  ol 

f 

Released 

Sequen-  Run 

Time  Subject 

tial  Search  I.D. 

Enters 

Sun  First 

Run  No.  Mode  No. 

Habitat 

Subject  Angle  Target 

Remarks 

t 


I  a 

i  . 
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SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-17 
LIGHTING  ADJUSTMENTS 

NOTE:  This  procedure  covers  adjustment  of  light  levels  and  color  only. 

For  solar  simulator  spatial  positioning,  see  Procedure  SVIBl-6. 

1.  OVERHEAD  FLUORESCENT  LIGHTING  -  This  light  source  is  used  to  provide 
a  diffuse  overhead  lighting  simulating  an  overcast  sky  during  all 
experiments,  and  at  a  lower  level,  skylight  when  the  solar  simulator 
is  in  use.  For  overcast  sky  simulation,  all  lights  will  be  on  to 
provide  maximum  lighting  for  the  television  system.  This  level  will 

be  measured  each  day  during  laboratory  verification  (Procedure  SVIBl-9). 
The  level  will  be  recorded  on  Form  SVIB.1-17A  only  when  lamp  failure 
degrades  the  level  below  the  previous  reading  and  again  when  lights  are 
replaced.  See  Steps  3  and  4  for  operation  as  the  skylight  source. 

2.  OVERHEAD  INCANDESCENT  LIGHTING  -  These  lights  may  be  used  at  a  low 
level  to  provide  additional  red  light  to  optimize  the  television 
sensor  performance.  If  used,  the  level  will  be  measured  (in  the 
absence  of  other  light)  and  recorded  on  Form  SVIB1-17A  on  a  one  time 
basis  unless  the  level  is  changed. 

3.  SOLAR  SIMULATOR  -  The  solar  simulator  output  level  is  not  variable,  but 
can  be  expected  to  degrade  to  about  90  percent  of  its  initial  level 
during  the  life  of  the  lamp.  The  level  will  be  measured  daily,  but 
recorded  only  when  the  ratio  of  solar  simulator  to  overhead  lighting 
changes  sufficiently  to  require  adjustment. 

4.  SKYLIGHT  SIMULATION  (Overhead  fluorescent)  -  The  overhead  light  level 
used  to  simulate  skylight  will  be  about  18  percent  to  20  percent  of 
the  output  of  the  solar  simulator.  Since  the  solar  simulator  cannot 
be  varied,  but  may  degrade  with  age,  the  overhead  lighting  will  have 
to  be  varied  to  provide  the  desired  ratio.  Since  the  fluorescents 

are  switched  in  50  foot-candle  (at  the  surface  of  the  model)  increments 
from  the  control  room,  and  in  50  foot-candle  increments  (but  with 
different  physical  separation  between  lamps)  by  the  circuit  breakers, 
it  is  possible  through  various  combinations  of  switches  and  breakers 
to  set  up  a  variety  of  uniform  lighting  levels.  Uniform  levels  for 
various  switching  combinations  will  be  established  as  required. 

The  level  selected  will  be  verified  by  measurement  and  recorded. 
Measurements  will  be  checked  each  day,  but  recorded  only  when  changes 
take  place. 
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SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-18 
SECURITY 


s 


NOTE:  Although  these  experiments  are  unclassified,  the  Guidance 

Development  Center  is  a  closed  area  and  these  security  pro¬ 
cedures  must  be  followed. 

1.  Experimental  Observers  will  be  escorted  at  all  times  while  in  the  GDC. 

2.  The  overhead  door  will  be  kept  under  direct  surveillance  by  an 
authorized  person  while  open. 

3.  Visitors  to  the  GDC  will  be  handled  in  accordance  with  existing 
security  instructions  and  the  instructions  of  the  laboratory  security 
custodian. 

4.  Particular  care  will  be  exercised  by  the  Experimenters  and  others 
escorting  personnel  that  there  is  no  chance  of  unauthorized  observation 
of  door  lock  combinations. 
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SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-19 
HELMET-MOUNTED  SIGHT  OPERATION 

1.  Connect  helmet  before  turning  power  on. 

2.  Turn  power  switch  to  ON. 

a.  Bias  required  light  should  be  lit. 

3.  Turn  Mode  Select  switch  to  "Test"  and  turn  up  Reticle  Display  Intensity 
until  subject  can  see  reticle  and  discrete  light  satisfactorily.  In 
the  "Test"  position  mode  the  HMS  is  outputting  +60  degrees  Az  and 

0  degree  El. 

4.  Turn  mode  select  switch  to  "Normal"  and  discrete  lights  will  go  off  and 
the  reticle  will  stay  lit. 

NOTE:  Reticle  will  go  out  if  subject  is  not  in  motion  box. 

5.  Turn  mode  select  switch  to  boresight. 

a.  Subject  will  not  be  outputting  LOS,  but  the  helmet  mounted  sight 
(HMS)  will  be  outputting  0  degree  Az  and  0  degree  El. 

NOTE:  This  is  true  only  if  the  bias  required  light  is  on. 

6.  Instruct  subject  to  place  the  HMS  reticle  over  the  boresight  target 
and  turn  the  mode  select  switch  to  "Bias  Store." 

NOTE:  Subject  must  hold  mode  select  switch  in  "Bias  Store"  position 
for  1/2  sec. 

7.  Turn  mode  select  switch  to  "Normal"  and  the  HMS  is  now  boresighted  and 
outputting  LOS. 

8.  After  completion  of  HMS  operation  turn  power  switch  off  before  dis¬ 
connecting  the  helmet. 
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APPENDIX  F 

EXPERIMENTER'S  LOG  AND  POST-RUN 
PRINTOUT  SAMPLES 
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Examples  of  the  Experimenter's  log  and  the  post-run  printout 
are  presented  in  the  following  order: 

1^  Experimenter  Log  Sheet  remarks  codes 

2_  Sample  Experimenter's  log  sheet  for  sub-experiments  1 
and  3 

_3  Sample  computer  printout  corresponding  to  2  above. 

[Note  -  this  sample  is  representative  of  the  "batching" 
process  used  with  90  degrees  sun  azimuth;  therefore  there 
are  four  separate  printouts,  one  for  each  of  the  four  run 
sets  (targets  1  and  2,  target  3,  targets  4  and  5,  and 
target  6)  made  by  the  sample  observer.] 

4^  Sample  Experimenter's  log  sheet  for  sub-experiment  2 

.5  Sample  computer  printout  corresponding  to  4  above 

j6  Sample  Experimenter's  log  sheet  for  sub-experiment  4 

]_  Sample  computer  printout  corresponding  to  6  above 

8.  Sample  Experimenter's  log  sheet  for  sub-experiment  5 

9.  Sample  computer  printout  corresponding  to  8  above. 
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EXPERIMENTAL  LOG  SHEET  REMARKS  CODE 


SEEKVAL  Fixed  Wing 

Post-Run  Sub-experiments 

Remarks  Code  1,  2,  and  3 


1.  Direct  Vision  -  No  other  comment 

A.  See  Data  Sheet 

2.  HS:TV  -  No  other  comment 

B.  See  Data  Sheet 

3.  SC:TV  -  No  other  comment 

C.  See  Data  Sheet 

4.  DV  +  HS:TV  -  No  other  comment 

D.  See  Data  Sheet 

5.  DV  +  SC:TV  -  No  other  comment 

E.  See  Data  Sheet 

6.  HS:TV  +  SC:TV  -  No  other  comment 

F.  See  Data  Sheet 

7.  DV  +  HS:TV  -  No  other  comment 

G.  See  Data  Sheet 


SEEKVAL  Rotary  Wing 

Post-Run  Sub-experiments 

Remarks  Code  4  and  5 


1.  Direct  Vision  -  No  other  comment 

A.  See  Data  Sheet 

2.  PC:TV  -  No  other  comment 

B.  See  Data  Sheet 

3.  SC:TV  -  No  other  comment 

C.  See  Data  Sheet 

4.  DV  +  PC:TV  -  No  other  comment 

D.  See  Data  Sheet 

5.  DV  +  SC:TV  -  No  other  comment 

E.  See  Data  Sheet 

6.  PC :TV  +  SC:TV  -  No  other  comment 

F.  See  Data  Sheet 

7.  DV  +  PC :TV  +  SC:TV  - 
No  other  comment 

G.  See  Data  Sheet 

8.  SO  -  No  other  comment 

H.  See  Data  Sheet 

9.  SO  +  DV  -  No  other  comment 
J.  See  Data  Sheet 

N  -  Abort  (wrong  area  or  in¬ 
advertent  triggering) 

(Note:  A  time-out  (at  60  sec) 
is  indicated  by  the  appropriate 
letter  symbol  with  comment  on 
Data  Sheet) 
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"EXAMPLE"  FOR  EXPERIMENTS  1  &  3 

SEEKVAL  Ifcl  Experimenter's  Check  Sheet  &  Manual  Log 


||  Date  \l  UT  /*?  ^  Experimenter 


Experiment  No.  _ 1 


Serial  No.  3.4- 


Run  \  \  A  4» 

Table  Conflg. 


Method 


Sun  El  4P*  Az 


"Mission"  Briefing  i* 


'Run"  Briefing 


Target  Color _ £ 

Bkgrd  Color  _ £ 

Targets  per  Zone 


CL/CON 


Photo  Provided 


No.  Tgts 

^  R^porte^l  j  Target  Descriptii 

#3_ _ O  _ OX- _ 


Rerr’prk‘5 


0 _ » 


rf*  * 


-JMk- 


>ta-d 


S"<?a  r-c,i 


Debrief : 
Experiment 


fiT 


No  Communication  ■ 


Not  back  to  trailer 


Thanks 
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SEEKVAL  IB1  EXPERIMENTER  -  ROMANS  START  TIME  15:30  JAN  15, ’75 
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APPENDIX  G 


OBSERVER  AUDIT 


The  Observer  audit  was  conducted  throughout  the  course  of  the 
IB1  experiments.  Names,  subject  numbers  and  suffixes,  run  numbers,  and 
source  information  were  transferred  daily  from  the  daily  log  to  the  audit 
form.  At  intervals  of  two  or  three  days,  subject  questionnaires,  Experi¬ 
menter's  data  sheets,  and  debriefing  questionnaires  were  audited  and  appro¬ 
priate  notation  made  on  the  audit  form  to  indicate  the  presence  of  these 
data  in  the  files.  The  audit  form  column  headings  and  notation  are  as 
follows : 

Subject  Number  -  Serial  number  assigned  each  Observer  in  reporting  order. 

Suffix  -  Decimal  portion  of  subject  number.  Subjects  001  through  061  had 

either  a  .1  or  .2  assigned  (with  the  exception  of  012  and  013). 
Military  subjects  were  assigned  .1  and  Martin  Marietta  subjects 
were  .2.  Subjects  012  and  013  both  have  a  .3  suffix  assigned, 
for  013  to  indicate  a  Martin  Marietta  employee  running  as  a 
trained  subject;  the  012  number  was  assigned  after  18  December 
1974  when  the  .3  suffix  indicated  no  comment.  Suffix  codes 
as  used  subsequent  to  18  December  1974  are  as  follows: 

1.  and  .2  -  Not  used 
.3  -  No  comment 
.4  -  Better  than  20/20  vision 
.5  -  Less  than  20/20  vision 
.6  -  Color  blind 

.7  -  Better  than  20/20,  but  color  blind 
.8  -  Less  than  20/20,  and  color  blind 
.9  -  Ill 

.0  -  Considerable  difference  between  left  and  right  eye 

Run  -  Sequential  run  number  (First  digit  indicates  experiment  number). 

Source  -  Observer's  organization,  i.e.,  company  or  service 

Subject  Questionnaire  -  A  mark  in  this  column  indicates  that  the  auditor 
sighted  the  questionnaire  filled  out  by  this  subject. 

Experimenter  Data  Sheet  -  The  last  initial  of  the  Experimenter  appearing 
in  this  column  signifies  that  the  auditor  has  sighted  the 
data  sheet  and  that  run  and  subject  numbers  agree  with  other 
data. 

Debriefing  Questionnaire  -  A  mark  in  this  column  indicates  that  the  auditor 
has  sighted  the  questionnaire  filled  out  by  this  subject. 


Date  -  Date  subject  made  his  runs 

Name  -  Observer's  name  -  Used  only  on  master  audit  form  (Good  experimental 
practice  suggests  deletion  of  subject's  names  from  published 
documents) . 

Comments  -  Self-explanatory 
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APPENDIX  H 


RAW  DATA  RETRIEVAL 


The  following  raw  data  have  not  been  reproduced  as  part  of  this 
report  because  of  their  bulk  and  limited  value.  The  originals  are  available 
through  the  SEEKVAL  Program  Office. 

1.  Record  photographs  (8  x  10  color  prints  and  35  mm  black- 
and-white  negatives) 

2.  Photometric  data  sheets 

3.  Run  data  punched  cards 

4.  Daily  run  schedule  and  log 

5.  Experimenter's  check  sheet  and  manual  log 

6.  Subject  questionnaire 

7.  Debriefing  questionnaires 

8.  Observer  audit. 

Likewise,  the  two  color  video  tapes  used  for  briefing  and  the 
black  and  white  video  tapes-*-  on  which  the  experimental  runs  were  recorded 
can  be  found  at  the  SEEKVAL  Program  Office. 


^An  attempt  was  made  to  record  on  video  tape  every  experimental  run,  by 
recording  from  the  Observer's  TV  sensor.  Recording  began  when  the  Experi¬ 
menter  pressed  the  "start"  button  and  called  out  the  run  number  on  his 
audio  channel.  This  audio  was  recorded  on  the  video  tape,  so  each  re¬ 
corded  run  can  be  identified.  Recording  of  the  run  stopped  when  the 
Observer  signaled  acquisition. 

This  recording  was  more  successful  in  the  fixed  wing  experiments,  since 
the  TV  sensor  was  always  guided  by  either  the  Observer's  head  movement  or 
the  control  stick.  However,  many  of  the  rotary  wing  experimental  runs  did 
not  use  the  TV  sensor  since  even  though  the  TV  aid  was  available,  the 
Observer  often  chose  not  to  use  it.  In  other  runs,  the  time  to  acquisition 
was  so  short  that  the  recorded  video  offers  only  a  glimpse  of  the  terrain 
model  and  the  audio  identification  could  not  be  completed. 


SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-1A 
READY  ROOM  BRIEFING  PRESENTATION 
FIXED  WING 


EXHIBIT  I 


Welcome  to  Martin  Marietta  and  to  the  SEEKVAL  Combat  Air  Support  Target 
Acquisition  Program.  You  are  about  to  become  an  observer  in  an  experiment  pro¬ 
gram  sponsored  by  the  Department  of  Defense  Combat  Air  Support  Target  Acquisition 
Program  known  as  "SEEKVAL."  The  purpose  of  this  program  is  to  investigate  the 
acquisition  of  ground  targets  from  the  air. 

In  a  mobile  ground  war,  a  critical  task  to  be  performed  from  the  air  is 
the  location  and  destruction  of  tanks  and  trucks  during  missions  of  close  air 
support  of  ground  forces,  interdiction  of  roads,  trails  and  rivers,  and  in 
strikes  against  the  enemy's  lines  of  communications.  In  the  case  of  mobile 
warfare,  one  of  the  hardest  tasks  is  that  of  locating  vehicles  in  spite  of  the 
enemy's  attempts  at  camouflage,  use  of  covering  terrain  as  masks,  during  adverse 
weather  and  low-visibility  conditions.  Obviously  we  want  to  make  target  acquisition 
at  maximum  ranges  and  as  quickly  as  possible.  A  first-pass  capability  is  desirable 
to  reduce  aircraft  losses.  Recent  past  military  operations  reveals  that  the  detec¬ 
tion  and  recognition  of  vehicles  from  the  air  is  not  an  easy  task  from  modern  high¬ 
speed  aircraft.  As  you  probably  know,  targets  the  size  of  tanks  are  not  easy  to 
"spot"  even  in  normal  terrain  conditions  such  as  may  be  encountered  in  a  representative 
portion  of  the  Central  European  environment.  Even  with  visual  aids  such  as  stabilized 
optics  and  special  electro-optical  devices,  not  all  of  the  possible  targets  are 
detected  and  the  average  acquisition  rate  in  combat  may  be  well  below  50%.  Recog¬ 
nizing  this  problem,  the  Director  of  the  Department  of  Defense  Research  &  Engineering 
instituted  a  systematic  program  of  research  to  determine  the  performance  that  could 
be  expected  in  acquiring  targets  from  the  air  by  direct  vision  and  by  the  use  of 
visual  aids  under  various  test  conditions. 
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The  conditions  we  are  testing  here  include  evaluation  of  various  methods 
of  search  and  techniques  of  target  acquisition.  The  scientists  providing  the 
technical  guidance  on  this  program  have  determined  that  a  large  terrain  table 
simulation  program  of  research  augmented  by  judicious  flight  testing  is  one 
method  of  approach  to  be  used. 

The  Martin  Marietta  Aerospace  Optical  Laboratory  has  been  selected  as  one 
of  the  primary  experimental  locations  because  of  its  capability  for  simulating 
flight  profiles  and  because  of  its  visual  laboratory  system  and  computational 
capability  as  well  as  our  extensive  prior  research  into  the  problems  of  target 
acquisition.  Our  large  terrain  table  provides  realistic  representation  of  the 
ground  in  which  will  be  located  the  tank  targets  that  you  will  be  searching  for 
from  your  cockpit.  To  simulate  flight  over  the  target  area  your  cockpit  stays  in 
place  while  the  terrain  table  will  be  moved  to  simulate  flight  conditions.  You 
will  search  for  targets  by  looking  out  the  windscreen  of  a  simulated  cockpit. 

In  all  cases  here  your  tactical  targets  will  be  US  M60  tanks  located  in  various 
areas  on  the  terrain  table. 

Here  we  are  running  five  separate  experiments.  These  in  general  are  three 
(3)  tests  using  fixed  wing  flight  profiles  and  two  (2)  using  helicopter  pop-up 
maneuvers.  You  will  be  a  member  of  our  test  team  in  a  fixed  wing  experi¬ 
ment.  Your  job  will  be  to  act  as  an  observer  and  find  the  tank  targets  for  us. 

We  want  to  find  out  how  well  you  can  find  these  tanks  under  the  experimental 
conditions  of  illumination,  target  locations,  ranges  and  altitudes  that  are  being 
controlled  in  our  tests.  Obviously  some  of  these  targets  will  be  easy,  some  will 
be  hard. 

We  are  not  grading  your  performance  as  an  individual  and  you  will  not  be 
given  a  "score."  There  are  no  right  answers.  This  is  scientific  research,  not 
performance  testing.  In  this  scientific  experiment,  you  are  to  be  a  key  member 


of  the  experimental  team.  Your  ability  to  find  the  targets  is  crucial  to  our 
study.  Thus  we  espect  you  to  try  to  do  your  very  best. 

We  will  do  the  following  things  here  today: 

1.  First,  we  will  also  need  some  personal  information,  some  idea  about  flying 
experience,  and  about  any  special  experience  or  training  you  may  have 

had  in  tactical  target  acquisition. 

2.  Next,  we  will  ask  you  to  take  a  vision  test.  The  objective  of  this  test  is 
to  establish  your  baseline  visual  capabilities.  Since  finding  targets  is 
primarily  a  visual  operation,  you  can  understand  our  need  for  this 
information. 

3.  We  will  show  you  a  TV  tape  of  the  target  area  and  typical  targets. 

4.  We  will  give  you  a  chance  to  see  the  map  of  the  target  area  in  which 
you  will  be  working,  and  we'll  ask  you  to  look  at  some  aerial  photo¬ 
graphs  of  our  operational  area.  We  expect  you  to  become  as  thoroughly 
familiar  with  the  terrain  of  the  target  area  as  it  is  possible  to  be  without 
an  actual  check  ride  over  it.  You  are  going  out  on  a  target  acquisition 
flight.  It  will  simulate  an  armed  area  search  for  tanks  as  targets. 

Any  target  (that  is  tanks)  you  find  in  this  area  can  be  considered  as 
targets  to  be  fired  upon.  Thus  your  complete  familiarity  with  the  area 
will  help  you  find  your  targets. 

5.  You  will  be  given  a  specific  mission  briefing  so  that  you  will  know  exactly 
what  you  will  be  doing  in  your  particular  test  series. 

6.  When  your  turn  comes  you'll  be  picked  up  by  your  test  experimenter. 

This  individual  will  be  your  personal  escort  for  the  test  series  you 
will  run.  He  will  escort  you  to  the  Optical  Laboratory  where  the  tests 


will  be  conducted. 


7 .  You  will  be  seated  in  the  cockpit  and  then  you  will  put  on  the  helmet 
that  will  be  used.  You  will  be  checked  out  on  the  specific  equip¬ 
ment  in  the  cockpit  and  the  procedures  you  are  to  follow  in  the  test  runs. 

You  will  be  allowed  several  minutes  practice  to  be  sure  that  you  know  how  the 
equipment  operates. 

8.  Then  the  test  runs  begin!  For  each  test  run  you  will  be  given  a  specific 
briefing  for  that  one  run.  The  target  area  in  which  you  are  to  search 
for  tanks  will  be  pointed  out  to  you  on  your  oblique  aerial  photograph. 

You  will  be  expected  to  search  that  area  for  tanks.  When  you  are  sure  of  your 
target,  you  can  signal  acquisition  by  pulling  the  switch  on  your  control 
stick.  This  signifies  that  you  have  found  the  target  and  the  run  will  end. 

9.  Then  the  experimenter  will  verify  with  you  the  target  location  by  a 
short  de-briefing  and  meanwhile  the  next  run  will  be  set  up. 

10.  After  you  have  finished  your  test  series,  the  experimenter  will  escort 

you  out  of  the  laboratory.  He  will  de-brief  you,  tell  you  about  your  part 
of  the  exercise  and  answer  any  questions  he  can.  When  you  are  finished 
you  are  then  free  to  go.  Meanwhile  we  ask  that  you  wait  in  the  Holding 
Room,  where  we  will  take  you  after  the  briefing  until  your  turn  to  ran 
the  tests.  After  the  runs,  Military  personnel  will  be  allowed  to  wait 
in  the  GDC  office  area  if  you  need  to  do  so. 

Coffee  and  tea  are  available.  This  coffee  mess  operates  on  the  honor  system. 

We  ask  your  cooperation.  The  bathroom  is  located  in  the  rear  of  this  room. 

Any  questions? 

Now,  would  you  please, fill  out  the  questionnaire?  Then  we'll  look  at  the 
TV  tape,  conduct  a  target  area  briefing,  take  the  vision  test,  and  demonstrate 
by  use  of  the  mockup  how  the  equipment  in  the  cockpit  simulator  works. 


SEEKVAL  SUBJECT  QUESTIONNAIRE 


EXHIBIT  II 


Do  Not  Write  in  this  Space 

Name _ _ 

Date  of  Birth _ _ 

Military:  1.  Rank _ 

2.  Serial  No. 

Martin 

Marietta:  1.  Badge  No. 

2.  Dept.  No. 

Do  you  wear  glasses?  a  Yes  ca  No  If  "Yes"  please  explain 


Subject  No. _ 

Date _ 

Time _ 

Vision  Test  Results 


Type  of  Flight  Experience  (If  any) : 

1.  <=i  Fixed  Wing  a  Rotary  Wing 

2.  Flight  Hours 

a.  □  0  -  500 

b.  a  500  -  1500 

c.  a  1500  -  over 


Comments : 


t 


\ 


t 


Combat  air  support  training  and  flight  experience  (If  any) _ 

- - - — - - - — - -  I 


Are  you  currently  on  active  flight  status? 
Type  of  flight  assignment _ 


Yes 


No 


L 


HOW  TO  SEARCH  FOR  AND  FIND  TARGETS 


EXHIBIT  III 


If  you  have  not  had  any  training  or  experience  in  air-to-ground  target 
search,  the  following  instructions  should  help  you. 

If  you  are  experienced,  we  suggest  you  review  this  information.  In  this 
simulation  your  targets  will  be  800:1  scale  models  of  U.S.  M-60  tanks.  (Examples 
of  the  scale  models  are  mounted  in  the  Briefing  Room.) 

TACTICS  &  FORMATION 

.  Russian  tanks  move  and  attack  in  platoon  formations. 

.  In  the  attack,  platoon  formations  are  usually  tanks  abreast 
(i.e.,  moving  in  a  line  parallel  to  each  other)  and  spaced 
50-60  meters  apart. 

.  Cross-country  tactical  movement  in  the  attack  is  the  rule. 

.  Roads  are  rarely  used  in  attack  situations. 

SEARCH  PROCEDURES 

.  Slowly  evenly  sweep  your  view  across  the  search  area. 

Your  eye  fixates  for  a  brief  second.  Thus  look  at  the  area  of 
search  the  way  you  read  this  page,  a  "chunk"  at  a  time. 

.  Targets  are  different  from  the  background  trees  and  bushes. 

Look  for  regular  shapes,  straight  lines. 

.  Know  the  relative  size  of  the  target  compared  to  the  expected 
background.  (See  example  in  the  Briefing  Room) 

.  Know  the  particular  shape  of  the  target.  Shape  changes  as  aspect 
angle  changes.  The  straight  lines  and  distinctive  pattern  of  tank 
gun,  hull,  and  treads  should  be  noted.  Bushes  and  trees  conversely, 
usually  have  less  precise  edges  and  corners. 

.  Know  where  to  expect  targets.  It  is  almost  impossible  to  see  tanks 
in  heavy  tree  cover.  In  this  attack  situation  you  should  search 
open  areas  and  fields.  Do  not  expect  to  see  tank  targets  in  the  trees. 

.  Differences  in  contrast  of  the  target  with  the  background  are  good 
cues.  Dark  targets  on  light  background  or  light  targets  on  dark 
background  may  be  cues. 

.  Shadow  may  help  emphasize  contrast  and  provide  a  cue  as  to  target  shape. 

.  Your  time  is  limited.  The  longer  you  remain  in  a  search  position  the  more 
likely  it  is  you  may  be  shot  at.  In  this  test  you  will  have  only  about 
one  minute  to  locate  the  area  and  find  your  targets.  Thus  "learn" 
the  area  by  careful  review  of  the  briefing  photos  and  maps. 

Spend  your  time  looking  for  targets. 

"Good  Luck"  is  really  careful  preparation. 


SEEKVAL  AIDED  VISUAL 
TERRAIN  TABLE  EXPERIMENT 


EXHIBIT  IV 


EXPERIMENT  IB1 
(FIXED-WING) 


TV  TAPE  SCRIPT 


Script:  D 
D 

December  6 
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.B.  Jones 
.G.  Smith 
,  1974 
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ft 
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SEEKVAL  AIDED  VISUAL  TERRAIN  TABLE  EXPERIMENT 
Experiment  IB1 

VIDEO  AUDIO 

1  TITLE : 

NARRATOR: 

This  is  the  optical  laboratory  of  the  Martin  Marietta 
Guidance  Development  Center. 

The  scale  terrain  model  housed  here  duplicates  topographical 
sections  of  Fort  Lewis,  Washington,  and  typical  Central 
European  rolling  hills. 

3  High  angle  view  Here  is  a  German  Farm  Village  with  crossroads  near  a 

of  table  zoom  out  river.  The  view  widens  to  reveal  a  pine  tree  forrested 

from  C.U.  to  L.S.  area  typical  of  Fort  Lewis. 

The  road  running  down  the  right  side  of  the  picture 
runs  north  and  south  on  the  table  through  our  area  of 
operations . 

Remember  that  the  terrain  model  is  merely  a  realistic 
simulation  of  these  geographic  areas. 

The  blue  structure  on  the  screen  is  the  simulated 
cockpit  or  habitat,  from  which  you  will  conduct  your 
search  for  targets. 

On  the  right  is  the  experimenter's  station  where  we 
will  record  the  results  of  your  target  acquisition 
experiment . 

The  simulated  cockpit  contains  several  important  features 
which  we  will  briefly  describe. 

On  the  operators  left  is  the  track  stick,  used  to  control 
and  point  the  sensor  in  the  aided  visual  experiments, 
and  to  record  when  you  have  acquired  the  target . 

The  right  thumb  button  actuates  the  Television  track 
stick. 

The  left  button  engages  the  helmet-mounted  sight. 

The  center  knob  controls  the  field  of  view  of  the  TV 
sensor . 

The  trigger  switch,  actuated  by  the  index  finger, 
indicates  that  you  have  identified  the  targets 
and  ends  the  experimental  run.. 

Located  directly  in  front  of  you  is  a  video  display 
unit . 

This  unit  is  used  in  the  aided  visual  experiments  only 
and  will  be  turned  off  during  the  direct  view  experiments. 


Pan  RT  to  ECU  T.V. 
display  and  zoom 
out  to  C.U.  cockpit 


5  C.U.  cockpit  zoom 
in  to  ECU 
track  stick 


4  L.S.  cockpit 
dolly  in  and 
zoom  to  C.U. 
cockpit. 


2  Floor  level 
overall  pan 
of  environment 


VIDEO 


AUDIO 


b  C.S.  cockpit  and 
experimenter 
station 

(FADE  OUT) 

(FADE  IN) 

7  Overall  shot 
Terrain  Model 


8  M.S.  village  on 
terrain  model 
(Color  Run  #1) 


9  Black  and  white 
Run  //I 


10  Color  Run  #2 


11  B&W  Run  #2 


Located  to  the  pilot's  left  is  the  experimenter's 
station  where  the  experimenter  will  record  the  test  data. 


You  will  be  brought  to  a  simulated  altitide  of  3000  feet 
and  fixed  in  position. 

The  terrain  table  will  "fly"  under  you  at  a  simulated 
ground  speed  of  420  knots,  representing  the  "fast  FAC" 
or  forward  air  controller  environment. 

Our  target  for  this  first  demonstration  run  is  a 
column  of  tanks  at  the  road  junction  in  the  village. 

The  tanks  are  traveling  from  east  to  west  on  the  horizontal 
road  and  northwest  on  the  vertical  road. 

Now  you  should  be  able  to  see  the  tanks  cleariy.  One 
tank  has  just  turned  right  heading  northwest  on  the 
crossroad. 

The  aided  visual  portion  of  the  experiment  will  be 
conducted  using  black  and  white  television  imagery. 

Let's  repeat  the  previous  scene  using  the  black 
and  white  television  system  that  you  will  be  using. 

You  can  now  see  tanks  at  the  crossroad. 

Now  we  will  run  a  series  of  color  and  black  and  white 
runs  at  various  target  locations. 

In  this  case,  a  tank  is  located  in  the  center  of  the 
screen  just  to  the  left  of  a  small  group  of  trees. 

The  scene  is  scalled  at  800  to  1. 

Now  let's  repeat  the  scene  with  the  black  and  white 
camera  with  a  zoom  to  the  narrow  field  of  view. 


12  Color  Run  #3 


13  B&W  Run  it  3 


14  Overall  shot 
over  terrain 
to  simulate  zoom 
in  to  cockpit 
module 


The  location  of  the  tanks  in  this  run  is  to  the  left 
°f  an  airstrip  which  is  situated  in  the  northeast 
sector  of  our  area  of  operations. 

Looking  closely,  you  can  see  one  tank  on  the  road 
and  two  approaching  the  airstrip. 

Now  we  will  repeat  this  acquisition  demonstration 
using  the  black  and  white  camera. 

Can  you  identify  the  three  tanks? 

The  previous  illustration  runs  have  been  shown  so  that 
you  will  have  some  idea  of  what  will  be  required 
of  you  during  the  experiments. 


VIDEO 


AUDIO 


The  video  program  has  also  shown  you  the  environment 
you  will  be  working  in. 

Your  participation  in  this  experiment  is  essential 
to  the  scientific  evaluation  of  some  of  the  key 
factors  in  target  acquisition. 

The  success  of  our  joint  effort  depends  on  your  active 
and  efficient  performance  in  our  simulation  of  the 
combat  air  support  target  acquisition  process. 

Thank  you  for  your  participation. 


15  TITLE:  Martin 

Marietta 


SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-1C 

FIXED-WING  MISSION  BRIEFING  EXHIBIT  V 

Here  on  the  wall  is  a  photograph  of  our  terrain  model.  The  model  is  12 
meters  by  12  meters.  This  photograph  is  an  oblique  view  representing  what  you  will 
see  from  the  cockpit  simulator  as  you  approach  your  target  area.  The  photograph 
is  divided  into  six  different  target  areas.  You  will  search  for  your  targets 
one  area  at  a  time.  Your  targets  will  be  only  tanks.  They  will  be  exactly  the  size 
of  the  tanks  you  see  on  the  model  here.  The  tanks  will  always  be  on  the  open 
terrain,  although  some  clutter  may  be  around  them,  and  never  in  the  heavily  forested 
areas.  You  will  be  flying  over  a  free-fire  zone.  Any  tank  you  see  in  the  particular 
area  you  are  searching  is  a  target. 

You  will  carry  with  you  in  your  cockpit  a  copy  of  this  photograph  with  the 
six  target  areas  outlined,  to  be  used  as  a  mission  briefing.  Your  experimenter 
will  tell  you  in  which  area  to  search,  prior  to  your  runs.  The  map  above  is  a  top 
view  of  the  same  terrain  with  the  six  target  areas  outlined.  It  shows  topographical 
features  of  the  terrain.  On  the  sides  are  close-up  view  photographs  of  the  six 
target  areas  (see  SVIB1-1C1) . 

As  you  saw  in  the  film,  your  cockpit  will  be  brought  to  a  simulated  altitude 
of  3000  f  (914  meters)  and  fixed  in  position.  The  curtain  in  front  of  you  will 
be  lifted  as  the  terrain  starts  moving  towards  you,  simulating  a  flight  speed  of 
about  400  knots  (736  km/h). 

When  you  see  your  target  you  signal  acquisition  by  pressing  the  trigger  on  the 
control  stick.  You  signal  acquisition  when  you  are  sure  enough  of  your  target's 
location  that  you  are  willing  to  commit  ordnance.  (Remember  that  the  "enemy"  could 
be  shooting  back.)  Immediately  the  curtain  comes  down  in  front  of  you,  the  run  stops 
and  the  range  at  which  you  spotted  your  target  is  recorded  by  the  computer. 

While  the  curtain  is  down,  the  cockpit  and  terrain  will  be  repositioned  for 
the  next  run.  During  this  time  your  experimenter  will  ask  you  questions  about  the 
targe  ;ju  just  saw.  You  can  show  him  by  pointing  out  on  your  photograph,  the 
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location  of  the  targets,  the  number  of  tanks  that  you  saw,  the  color  of  the  tanks, 
and,  if  you  were  close  enough  to  tell,  the  direction  in  which  the  tanks  were 
headed . 

Although  there  may  be  more  than  one  tank  per  target  area,  you  trigr;er-off 
only  once. 

Your  cockpit  will  be  positioned  either  left  or  right,  depending  on  which 
side  of  the  terrain  you  are  searching  for  targets  in. 

You  will  always  be  flying  north,  straight  and  level.  You  will  not  "fly" 
the  aircraft  at  all. 

Are  there  any  questions  on  what  we  have  talked  about  so  far? 

Now? using  the  mockup,  I  will  demonstrate  what  you  will  do  in  your  cockpit. 

Each  one  of  you  will  use  one  of  the  four  different  search  methods:  direct  vision, 
in  which  you  look  directly  at  the  terrain  and  when  you  see  the  target  you  press 
the  trigger;  direct  vision  aided  by  the  TV  sensor  with  the  lens  on  a  wide  field  of 
view;  direct  vision  aided  by  the  TV  sensor  with  the  lens  on  a  narrow  field  of  view; 
and  direct  vision  aided  by  the  TV  sensor  with  the  zoom  lens  capability. 

(At  this  point  tell  each  observer  what  type  of  search  method  they  will  use.) 

(Call  out  the  first  name  and  demonstrate  equipment.  Example:) 

Direct  Vision: 

You  will  enter  your  cockpit  and  sit  on  a  seat  identical  to  this  one;  you 
will  fasten  the  safety  straps;  you  will  wear  a  helmet  like  this  one  (aid  observer 
in  putting  helmet  on) .  This  helmet  has  a  helmet  sight  which  you  will  see  on 
your  visor.  I  will  lower  the  visor.  (Turn  helmet  sight  on.)  Do  you  see  the 
reticle?  The  brightness  of  the  reticle  can  be  adjusted.  You  will  use  the  reticle 
to  acquire  targets.  The  TV  sensor  is  linked  to  your  helmet  sight.  Although 
you  will  use  only  direct  vision  and  your  TV  screen  will  be  off,  your  Experimenter 
has  a  TV  display.  His  will  be  on  and  he  can  see  where  you  are  searching. 
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However,  for  the  TV  sensor  to  be  guided  properly,  you  must  look  through  the  reticle 
at  all  times  and  search  by  moving  your  head  instead  of  moving  your  eyes  across 
the  visor.  The  helmet  sight  will  be  boresighted  for  each  one  of  you  individually 
to  insure  accurate  control  of  the  TV  sensor.  (Aid  observer  in  removing  helmet  and 
show  how  helmet  sensors  work.)  There  will  be  sensors  on  either  side  of  your 
cockpit.  They  read  the  position  of  the  lights  on  the  sides  of  your  helmet  and 
thus  guide  the  TV  sensor. 

(Call  out  the  next  observer  and  demonstrate  equipment.  Example:) 

Wide  Field 

(Aid  observer  in  putting  on  helmet  and  ascertain  that  he  sees  the  reticle; 
then:) 

The  TV  screen  in  front  of  you  will  be  on  for  your  run  set.  It  is  there  to  help 
you  find  targets;  however,  you  are  not  required  to  use  it. 

Whatever  you  see  through  the  reticle  will  be  displayed  on  your  TV  screen. 

The  control  stick  on  your  left  side  can  also  be  used  for  controlling  the  TV 
sensor.  The  knob  on  the  center  is  the  zoom  control.  It  will  be  inoperative 
for  your  runs  since  you  will  only  use  the  lens  set  on  wide  field. 

The  buttons  marked  "H"  and  "S"  control  the  mode  of  the  TV  sensor.  In  the  "H," 
or  helmet  mode,  the  sensor  is  guided  by  your  head  movement. 

To  look  at  your  screen,  press  the  "S"  or  stick  mode.  That  disengages  the 
TV  sensor  from  your  helmet  sight  and  leaves  It  pointing  in  the  direction  in  which 
you  were  looking  at  the  time  you  pressed  the  "S"  button. 

Now  you  can  look  down  at  your  TV  screen  and  control  the  TV  sensor  by  moving 

the  stick.  , 

If  you  want  to  look  directly  at  the  terrain  again,  press  the  "H"  button 
and  the  sensor  goes  back  to  the  helmet  mode.  You  can  switch  back  and  forth  any 
number  of  times  and  you  can  trigger  off  either  looking  directly  at  the  terrain 
through  the  reticle  or  looking  at  your  TV  screen. 
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Narrow  Field 


(The  briefing  for  the  narrow  field  of  view  was  essentially  the  same  as 
for  the  wide  field  except  that  the  scene  on  the  TV  screen  is  a  much  narrower 
area.) 

Variable  Field 

(The  briefing  for  the  variable  field  of  view  was  essentially  the  same  as 
for  the  wide  field  except  that  the  field  of  view  can  be  varied  using  the 
zoom  control.) 

For  those  of  you  who  will  be  using  the  TV  aid,  you  will  get  a  chance  to 
"play"  with  it  before  you  start  your  runs  so  that  you  will  be  fully  familiar 
with  its  operation.  Remember  that  the  TV  is  an  aid.  You  do  not  have  to 
use  it  if  you  find  you  can  do  better  without  it. 

Let  me  reiterate  some  of  the  important  things  to  remember: 

1)  When  looking  directly  at  the  terrain,  look  through  the  reticle  and 
search  by  moving  your  head  and  not  your  eyes. 

2)  Make  sure  that  the  TV  sensor  is  in  the  right  mode  (H  or  S)  so 
that  your  experiment  can  see  what  you  are  looking  at. 

If  there  are  no  more  questions  we  will  go  to  the  Holding  Room,  which  is  right 
outside  the  lab.  There  you  will  wait  for  your  Experimenter.  You  will  not  return 
to  this  room,  so  take  all  personal  belongings  with  you. 

(Observers  are  transferred  to  Holding  Room) 


Exhibit  X.  Target  Area  III 


Exhibit  XIII.  Target  Area  VI 
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SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-1C1 

FIXED  WING  TARGET  AREA  DESCRIPTION  EXHIBIT  XIV 

Area  I  is  in  the  SW  corner  (your  near  left  corner)  of  the  terrain  table.  It 
is  bounded  by  the  main  N  &  S  road  in  the  approximate  center  of  the  table;  and 
by  the  road  that  runs  approximately  E  &  W  through  the  wooded  area  about  one-third 
of  the  distance  from  the  S  edge  to  the  N  edge  of  the  table. 

Tanks  are  reported  in  the  field  NE  sector  of  Area  I,  North  of  the  E-W  road  that 
bisects  the  Eastern  part  of  the  area  and  short  of  the  heavily  forested  tree  line. 


Area  II  -  This  area  also  lies  W  of  the  N  &  S  road ,  N  of  area  I  and  S  of  the  road 
that  runs  E  &  W  along  the  river  and  through  the  village. 

Tanks  are  reported  in  Area  II,  somewhere  in  the  field  just  North  of  the  heavily 
forested  space  in  the  center  of  the  area. 


Area  III  is  in  the  NW  corner  (your  far  left  corner)  of  the  terrain  table.  It 
is  bounded  on  the  S  by  the  road  that  runs  E  &  W  along  the  river  and  through  the 
village. 

Tanks  are  reported  in  Area  III,  in  the  open  field  East  of  the  hills. 


Area  IV  is  in  the  NE  corner  (your  far  right  corner)  of  the  terrain  table.  It 
is  bounded  on  the  W  by  the  N  &  S  road;  and  on  the  S  by  the  E  &W  road  that  runs 
just  N  of  the  airstrip. 

Tanks  are  reported  in  Area  VI  in  the  open  field  N  of  the  E-W  road  that 

is  the  southern  boundary  of  the  area,  and  between  the  mountain  and  the  N-S  road. 


Area  V  -  W  of  the  N  &  S  road,  bounded  by  Area  IV  on  the  S  and  by  the  E  &  W  road 
that  runs  from  the  village,  just  N  of  the  airstrip  to  the  edge  of  the  table. 

Tanks  are  reported  East  of  the  N-S  road  on  the  East  side  of  the  area. 


Area  VI  -  This  area  is  in  the  SE  corner  (your  near  right  corner)  of  the  terrain 
table.  It  is  bounded  on  the  W  by  the  main  N  &  S  road;  and  on  the  N  by  the  E  &  W 
road  that  is  the  extension  of  the  N  boundary  of  Area  I. 

Tanks  are  reported  in  the  Northern  half  of  the  very  large  open  field  in  the 
center  of  Area  IV. 
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SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-4A 
FIXED  WING  RUN  BRIEFING 


EXHIBIT  XV 


You  have  reviewed  the  briefing  materials  and  should  be  familiar 
with  the  map  and  aerial  photos  of  the  target  area. 

Remember  that  the  target  area  is  a  free-fire  zone.  Any  tanks 
you  may  find  in  the  areas  can  be  fired  upon.  In  this  experiment  we  will 
ask  you  to  find  tanks  as  targets.  When  any  particular  target  has  been 
found  to  your  satisfaction,  place  the  helmet  sight  reticle  on  the  target 
and  keep  it  there  when  you  press  the  event  marker  switch.  Do  not  press 
the  switch  until  you  have  found  the  target  and  are  ready  to  end  the  run. 

On  the  track  stick  in  your  left  hand  is  the  event  marker  switch.  When  you 
pull  this  switch  you  are  indicating  that  you  have  found  the  target.  This 
means  that  you  have  found  a  target  and  are  sure  enough  of  its  location 
that  you  are  willing  to  attack.  When  you  pull  that  switch,  the  run  ends. 

Do  not  pull  it  until  you  find  the  target. 

As  you  look  for  targets  turn  your  head  so  that  the  helmet  sight 
reticle  is  on  the  area  in  which  you  are  searching  for  targets.  This  is  one 
way  we  have  of  knowing  where  you  are  looking. 

When  the  run  begins  this  curtain  will  rise  out  of  the  way  and 
you  can  see  the  area  of  operations.  The  terrain  will  be  so  far  away  that 
you  will  not  be  able  to  see  any  tanks.  First  find  the  area  in  which  your 
target  should  be  located,  then  begin  your  search  for  tanks.  When  you  find 
any  tanks  be  sure  to  keep  the  helmet  sight  reticle  on  them. 

When  you  have  found  the  target  pull  the  indicator  switch. 

That  terminates  the  run.  The  curtain  will  drop  in  front  of 
you.  I  will  then  ask  you  some  questions  about  the  target  to  help  verify 
some  of  the  data  we  are  collecting. 

If  by  chance  you  have  not  found  the  target  in  time  the  curtain 
will  close  and  that  also  ends  the  run. 

Meanwhile  the  model  returns  to  the  initial  location  and  the 
setup  for  the  next  run  is  prepared  and  verified. 

I  will  brief  you  on  the  next  target  and  we  repeat  the  sequence. 

Here  is  the  aerial  photograph  of  our  general  operational  area. 
Keep  it  for  all  flights.  On  this  mission  enemy  tanks  have  been  reported  in 
this  area  of  your  zone  of  operations.  The  target  area  is  described  as: 

(The  Observer  is  handed  the  photograph  (Exhibit  VII),  and  for  each  run  the 
appropriate  area  description  from  Exhibit  XIV  is  provided  verbally,) 
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Do  you  have  any  questions  about  how  we  will  operate?  Is  your 
helmet  sight  in  position? 

Do  you  understand  how  your  equipment  operates?  On  this  test 
you  will  search  for  targets  using  direct  vision.  (*If  this  is  an  aided 
mission,  the  comments  below  are  inserted  at  this  point.)  Remember  to 
place  the  helmet  sight  reticle  on  the  target  and  keep  it  there  when  you 
press  the  event  marker  switch.  Do  not  press  the  switch  until  you  have 
found  the  target  and  are  ready  to  end  the  run. 

Are  you  ready?  (To  test  conductor)  Experimenter  ready! 


* 


In  addition,  you  have  the  option  of  using  the  TV  system  as  an 
aid.  You  have  (here,  state  NF,  WF,  or  VF;  if  VF  identify  control  on 
track-stick) .  The  TV  camera  look-angle  is  controlled  by  your  helmet  sight 
but  the  control  may  be  shifted  to  the  track-stick  by  pressing  and  releasing 
this  button  on  the  track-stick.  Control  is  returned  to  the  helmet  by  press¬ 
ing  and  releasing  the  other  button. 


Now  I  will  raise  the  curtain  (you  cannot  see  the  terrain  model 
target  areas  from  this  elevation  and  distance).  Looking  along  this  edge  of 
the  model,  at  those  bolts  and  fittings,  practice  tracking  with  the  helmet 
sight  and  shifting  back  and  forth  from  the  track-stick  control.  There  is 
considerable  parallax  at  this  angle,  but  it  will  not  be  present  when  we  go 
to  altitude.  (Allow  about  a  minute  for  this  practice;  if  VF  add  practice 
with  zoom  and  suggest  WF  for  search  and  NF  for  identification).  Now  I  will 
lower  the  curtain  and  we  will  proceed. 


Dec.  3,  1974 


SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-8 

MISSION  DE-BRIEFING  EXHIBIT  XVI 

Thank  you  for  participating  in  this  series  of  SEEKVAL  experiments. 

As  I  told  you  when  we  first  began  our  runs,  there  are  no  right  answers. 

The  tests  have  been  designed  not  as  a  performance  measure  but  as  an  experiment. 

In  general,  your  mission  has  been  to  find  tank  targets  in  terrain  typical  of 
central  Europe.  We  have,  as  you  have  seen,  varied  locations  and  other  factors  related 
to  the  target.  Our  objective  has  been  to  secure  baseline  data  that  will  be  useful 
in  future  operations.  As  near  as  I  can  tell,  your  personal  performance  was  very 
good.  The  results  will  help  us  very  much. 

You  will,  I'm  certain,  have  a  chance  to  discuss  what  you  saw  and  did  here 
today  with  other  members  of  your  unit  (or  other  employees  at  Martin  Marietta).  We 
ask  you,  in  the  name  of  good  scientific  research,  not  to  talk  about  what  you  saw 
and  did  in  any  detail.  The  name  of  this  game  is  research.  In  the  good  name  of  science 
we  ask  you  to  not  discuss  your  results  with  others.  It  is  vital  to  the  experiment 
that  all  participants  start  out  with  essentially  the  same  knowledge  about  the 
terrain  and  the  operations  that  are  being  conducted.  If  you  talk  too  much  about 
the  situation,  especially  to  those  who  have  not  had  their  turn  you  could  well 
invalidate  the  results.  Particularly,  the  layout  of  the  terrain  and  the  target 
locations  are  sensitive  and  should  not  be  talked  about. 

You  should  also  know  that  not  everyone  is  doing  the  same  thing.  Each  group 
of  participants  here  will  perform  a  different  set  of  missions.  While  the  terrain 
in  which  you  searched  for  our  tank  targets  is  the  same  for  everyone  the  procedure 
used  and  the  targets  are  not  always  the  same.  Thus  even  if  you  "compare  notes" 
with  some  other  participants  you  may  find  out  he  did  not  do  what  you  did.  When  you 
do  this,  some  future  participant  may  hear  you. 
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Thank  you  again.  Your  part  is  done.  You  may  now  return  to  your  duties. 
Please  do  not  go  back  to  the  reception  and  briefing  area.  (Military  personnel 
may  wait  in  the  Debriefing  Room,  but  not  in  the  Ready  Room.  If  you  desire, 

I  will  escort  you  there.) 


NUMBER: 


SEEKVAL  DEBRIEFING  QUESTIONNAIRE  (  FIXED  WING)  EXHIBIT  XVII 

Please  help  us  with  this  study  by  answering  the  following  questions  honestly  and 
candidly. 

1.  Was  the  visual  scene  (terrain  model,  target  area  and  targets)  a  realistic 
simulation?  Yes  No. 

Comments 


I  _ _ 

2.  Did  the  target  area  briefings  help  you?  Yes  No 

Comments 


E  - — 

3.  Was  the  general  information  briefing  and  taped  TV  presentation  helpful  in  showing 
you  what  to  expect?  Yes  No 

Comments 


4.  For  many  test  runs  a  "spotlight"  was  used  to  simulate  the  sun's  shadows.  In 
your  opinion,  was  this  an  effective  simulation?  Yes  No 

Did  shadows  help  you  find  the  target?  Yes  No 

Comments _ _ 

I  _  _  ~ 


5. 

Did  the  helmet  sight 

help  you? 

Yes 

No 

Hinder  you? 

Yes 

No 

6. 

In  many  test  runs  a 

television  was 

available. 

Did  you  have  a  TV? 

Yes 

No 

If  yes,  please  answer  the  following: 


a. 

Did 

you 

use  the  TV  at  all? 

Yes 

No 

b. 

Did 

the 

TV  help  you  find  targets? 

Yes 

No 

c . 

Did 

the 

helmet  sight  help  you 

use 

the 

TV? 

Yes 

No 

d. 

Was 

the 

track  stick  helpful  in  using 

the 

TV? 

Yes 

No 

Comments 


7.  What  suggestions  can  you  make  to  help  improve  this  test? 


APPENDIX  J 


ROTARY  WING  BRIEFING  AND  DEBRIEFING 
MATERIALS  AND  OBSERVER  FLOW1 


Procurement  of  Experimental  Observers  took  two  forms,  one  for 
Martin  Marietta  personnel  (untrained),  the  other  for  military  personnel 
(trained) . 


Martin  Marietta  personnel  were  recruited  through  requests  for 
volunteers  appearing  in  the  company  weekly  newspaper.  In  a  few  cases. 
Observers  were  obtained  through  direct  requests  when  a  no-show  created  the 
necessity  for  quick  reaction.  In  every  case,  an  initial  telephone  contact 
was  used  to  explain  the  general  requirements  for  Observers  and  the  amount 
of  time  required.  Upon  acceptance  of  the  conditions,  the  prospective 
Observer  was  given  a  reporting  time  for  screening  and  briefing. 

Military  personnel  were  designated  by  the  Service  involved. 

They  too  were  given  a  reporting  time  through  coordination  with  the  supplying 
commands . 


All  Observers  were  directed  to  the  Guidance  Development  Center 
(GDC)  gate;  road  signs  were  employed  to  assist  military  personnel.  Report¬ 
ing  times  were  generally  such  that  briefings  were  conducted  for  groups  of 
four  Observers.  Upon  arrival  at  the  gate,  the  Observers  were  directed  to 
the  heliport  ready  room  by  the  security  guard  on  duty.  Upon  arrival  at  the 
ready  room,  Observers  were  greeted  by  their  briefer  and  given  a  folder  con¬ 
taining  a  copy  of  the  Ready  Room  briefing  presentation,  a  subject  question¬ 
naire,  and  a  short  instructional  presentation  on  target  search  procedures. 
These  appear  here  as  Exhibits  I,  II,  and  III. 

While  Observers  were  reading  the  briefing  material  and  filling 
out  the  questionnaire  they  were  called  one  by  one  to  take  the  visual  acuity 
and  color  perception  tests.  They  were  also  urged  at  this  time  to  use  their 
spare  time  studying  the  briefing  photos  and  map  posted  on  the  wall  (Exhibits 
VI  through  XI. 

Then,  the  color  TV  taped  briefing  was  shown.  The  script 
appears  here  as  Exhibit  IV.  Following  the  tape,  questions  were  solicited; 
the  answers  were  framed  not  to  exceed  the  level  of  briefing  presented  in 
the  written  material  while  being  as  complete  as  possible. 


This  Appendix  describes  the  Observer  flow  and  processing  used  in  rotary¬ 
wing  sub-experiments  4  and  5.  For  the  equivalent  presentation  of  fixed- 
wing  sub-experiments  1,  2,  and  3,  please  see  Appendix  I. 


The  mission  briefing,  Exhibit  V,  was  then  given.  The  first 
part  of  the  briefing  was  general,  dealing  with  the  terrain  model  map 
(Exhibit  VI),  the  oblique  color  photo  of  the  entire  terrain  model  (Exhibit 
VII),  the  four  area  photographs  and  area  description  (Exhibits  VIII  through 
XII),  and  an  18  inch  square  model  of  the  terrain  table  surface  at  the  same 
scale  with  three  tanks  emplaced.  The  tanks  were  arranged  in  line  abreast, 
exactly  as  they  appeared  on  the  terrain  table  but  the  Observers  were  not 
told  to  expect  this  particular  formation. 

Each  Observer  was  given  an  individual  briefing  using  the  mock- 
up  seat,  pantograph  sight  and  magnifying  optics,  and  gimbal  hand  controller 
in  the  ready  room.  This  portion  of  the  briefing  was  restricted  to  the  par¬ 
ticular  search  method  to  be  used  by  the  individual  Observer. 

All  briefed  Observers  were  then  transferred  to  the  holding 
area  where  they  awaited  their  turn.  Each  Observer,  in  turn,  was  escorted 
by  his  Experimenter  to  the  habitat  (taking  a  route  which  avoided  a  pre¬ 
view  of  the  terrain  table).  Once  inside,  the  Observer  was  given  his  run 
briefing  and  allowed  to  familiarize  himself  with  the  habitat  and  controls 
(Exhibit  XIII).  At  this  point,  and  throughout  his  runs,  the  Observer  had 
a  copy  of  the  overall  terrain  table  photo  (Exhibit  VI)  with  him  in  the 
cockpit . 

Upon  completion  of  his  runs,  the  Observer  was  escorted  to  the 
debriefing  area,  given  his  debriefing  (Exhibit  XIV),  and  asked  to  complete 
the  debriefing  questionnaire  (Exhibit  XV). 

Following  debriefing  the  Observers  were  asked  to  leave  the 
GDC  area;  if  military  Observers  wished  to  wait  for  other  personnel,  they 
were  asked  to  remain  clear  of  Observers  who  had  not  yet  been  tested. 


SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-1B 
READY  ROOM  BRIEFING  PRESENTATION 

HELICOPTER  EXHIBIT  I 

Welcome  to  Martin  Marietta  and  to  the  SEEKVAL  Combat  Air  Support  Target 
Acquisition  Program.  You  are  about  to  become  an  observer  in  an  experiment  pro¬ 
gram  sponsored  by  the  Department  of  Defense  Combat  Air  Support  Target  Acquisition 
Program  known  as  "SEEKVAL."  The  purpose  of  this  program  is  to  investigate  the 
acquisition  of  ground  targets  from  the  air. 

In  a  mobile  ground  war,  a  critical  task  to  be  performed  from  the  air  is 
the  location  and  destruction  of  tanks  and  trucks  during  missions  of  close  air 
support  of  ground  forces,  interdiction  of  roads,  trails  and  rivers,  and  in 
strikes  against  the  enemy's  lines  of  communications.  In  the  case  of  mobile 
warfare,  one  of  the  hardest  tasks  is  that  of  locating  vehicles  in  spite  of  the 
enemy's  attempts  at  camouflage,  use  of  covering  terrain  as  masks,  during  adverse 
weather  and  low-visibility  conditions.  Obviously  we  want  to  make  target  acquisition 
at  maximum  ranges  and  as  quickly  as  possible.  A  first-pass  capability  is  desirable 
to  reduce  aircraft  losses.  Recent  past  military  operations  reveals  that  the  detec¬ 
tion  and  recognition  of  vehicles  from  the  air  is  not  an  easy  task  from  modern  heli¬ 
copters.  As  you  probably  know,  targets  the  size  of  tanks  are  not  easy  to  "spot" 
even  in  normal  terrain  conditions  such  as  may  be  encountered  in  a  representative 
portion  of  the  Central  European  environment.  With  visual  aids  such  as  stabilized 
optics  and  special  electro-optical  devices,  not  all  of  the  possible  targets  are 
detected  and  the  average  acquisition  rate  in  combat  may  be  well  below  50%.  Recog¬ 
nizing  this  problem,  the  Director  of  the  Department  of  Defense  Research  &  Engineering 
instituted  a  systematic  program  of  research  to  determine  the  performance  that  could 
be  expected  in  acquiring  targets  from  the  air  by  direct  vision  and  by  the  use  of 
visual  aids  under  various  test  conditions. 
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The  conditions  we  are  testing  here  include  evaluation  of  various  methods 
of  search  and  techniques  of  target  acquisition.  The  scientists  providing  the 
technical  guidance  on  this  program  have  determined  that  a  large  terrain  table 
simulation  program  of  research  augmented  by  judicious  flight  testing  is  one 
method  of  approach  to  be  used. 

The  Martin  Marietta  Aerospace  Optical  Laboratory  has  been  selected  as  one 
of  the  primary  experimental  locations  because  of  its  capability  for  simulating 
flight  profiles  and  because  of  its  visual  laboratory  system  ?nd  computational 
capability  as  well  as  our  extensive  prior  research  into  the  problems  of  target 
acquisition.  Our  large  terrain  table  provides  realistic  representation  of  the 
ground  in  which  will  be  located  the  tank  targets  that  you  will  be  searching  for 
frojn  your  cockpit.  To  simulate  helicopter  pop-up  maneuvers  in  the  target  area,  your 
cockpit  will  be  set  at  a  selected  altitude  and  the  terrain  table  will  be  fixed 
under  you  to  simulate  the  desired  range.  You  will  search  for  targets  by  looking 
out  the  windscreen  of  a  simulated  cockpit.  In  all  cases  here  your  tactical  targets 
will  be  US  M60  tanks  located  in  various  areas  on  the  terrain  table. 

Here  we  are  running  five  separate  experiments.  These  in  general  are  three 
(3)  tests  using  fixed-wing  flight  profiles  and  two  (2)  using  helicopter  pop-up 
maneuvers.  You  will  be  a  member  of  our  test  team  in  a  Rotary  Wing  experiment. 

Your  Job  will  be  to  act  as  an  observer  and  find  the  tank  targets  for  us.  We 
want  to  find  out  how  well  you  can  find  these  tanks  under  the  experimental 
conditions  of  illumination,  target  locations,  ranges  and  altitudes  that  are  being 
controlled  in  our  tests.  Obviously  some  of  these  targets  will  be  easy,  some  will 
be  hard. 

We  are  not  grading  your  performance  as  an  individual  and  you  will  not  be 
glvan  a  "score."  There  are  no  right  answers.  This  is  scientific  research,  not 
performance  testing.  In  this  scientific  experiment,  you  are  to  be  a  key  member 
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of  the  experimental  team.  Your  ability  to  find  the  targets  is  crucial  to  our 
study.  Thus  we  expect  you  to  try  tc  do  your  very  best. 

We  will  do  the  following  things  here  today: 

1.  First  we  will  also  need  some  personal  information,  some  idea  about  flying 
experience,  and  about  any  special  experience  or  training  you  may  have 
had  in  tactical  target  acquisition. 

2.  Next  we  will  ask  you  to  take  a  vision  test  -  The  objective  of  this  test  is 
to  establish  your  baseline  visual  capabilities.  Since  finding  targets  is 
primarily  a  visual  operation  you  can  understand  our  need  for  this  information. 

3.  We  will  show  you  a  TV  tape  of  the  target  area  and  typical  targets. 

4.  We  will  give  you  a  chance  to  see  the  map  of  the  target  area  in  which 
you  will  be  working,  and  we'll  ask  you  to  look  at  some  aerial  photo¬ 
graphs  of  our  operational  area.  We  expect  you  to  become  as  thoroughly 
familiar  with  the  terrain  of  the  target  area  as  it  is  possible  to  be 
without  an  actual  check  ride  over  it.  You  are  going  out  on  a  target 
acquisition  flight.  It  will  simulate  an  armed  area  search  for  tanks  as 
targets.  Any  target  (that  is  tanks)  you  find  in  this  area  can  be  considered 
as  targets  to  be  fired  upon.  Thus  your  complete  familarity  with  the 

area  will  help  you  find  your  targets. 

5.  You  will  be  given  a  specific  mission  briefing  so  that  you  will  know  exactly 
what  you  will  be  doing  in  your  particular  test  series. 

6.  When  your  turn  comes  you'll  be  picked  up  by  your  test  experimenter. 

This  individual  will  be  your  personal  escort  for  the  test  series  you 
will  run.  He  will  escort  you  to  the  Optical  Laboratory  where  the  tests 
will  be  conducted. 

7.  You  will  be  seated  in  the  cockpit  and  checked  out  on  the  specific  equipment 
in  the  cockpit  and  the  procedures  you  are  to  follow  in  the  test  runs.  You 
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will  be  allowed  several  minutes  practice  to  be  sure  that  you  know  how  the 
equipment  operates . 

8.  Then  the  test  runs  begin!  For  each  test  run  you  will  be  given  a  specific 
briefing  for  that  one  target  acquisition.  The  target  area  in  which  you  are 
to  search  for  tanks  will  be  pointed  out  to  you  on  your  oblique  aerial  photo¬ 
graph.  You  will  be  expected  to  search  that  area  for  tanks.  When  you  are  sure 
of  your  target,  you  can  signal  acquisition  by  pulling  the  switch  on  your 
sighting  station  or  on  your  control  stick.  This  signifies  that  you  have  found 
the  target  and  the  run  will  end. 

9.  After  you  have  finished  your  test  series  the  experimenter  will  escort 
you  out  of  the  laboratory.  He  will  de-brief  you,  tell  you  about  your 

part  of  the  exercise  and  answer  any  questions  he  can.  When  you  are  finished 
you  are  then  free  to  go.  Meanwhile  we  ask  that  you  wait  in  the  Holding  Room 
where  we  will  take  you  after  the  briefing  until  you  are  notified.  After  the 
runs,  Military  personnel  will  be  allowed  to  wait  in  a  de-briefing  trailer  area 
if  you  need  to  do  so.  Coffee  and  tea  are  available.  This  coffee  mess 
operates  on  the  honor  system.  We  ask  your  cooperation.  The  bathroom  is 
located  in  the  rear  of  this  room.  Any  questions? 

Now,  would  you  please  fill  out  the  questionnaire?  We  will  take  the  vision  test, 
look  at  the  TV  tape,  conduct  a  target  area  briefing,  and  demonstrate,  by  use  of 
the  mockup,  how  the  equipment  in  the  cockpit  simulator  works. 


SEEKVAL  SUBJECT  QUESTIONNAIRE 


EXHIBIT  II 


Do  Not  Write  in  this  Space 

Name _ 

Date  of  Birth _ 

Military:  1.  Rank _ 

2.  Serial  No. 

Martin 

Marietta:  1.  Badge  No. 

2.  Dept.  No. 

Do  you  wear  glasses?  a  Yes  a  No  If  "Yes"  please  explain 


Subject  No. _ 

Date _ 

Time _ 

Vision  Test  Results 


Type  of  Flight  Experience  (If  any) : 

1,  ca  Fixed  Wing  ca  Rotary  Wing 

2 .  Flight  Hours 

a.  a  0  -  500 

b.  a  500  -  1500 

c.  a  1500  -  over 


Comments : 


Combat  air  support  training  and  flight  experience  (If  any) 


Are  you  currently  on  active  flight  status? 
Type  of  flight  assignment_ _ 


«=>  Yes 


C3  No 


HOW  TO  SEARCH  FOR  AND  FIND  TARGETS 


EXHIBIT  III 


If  you  have  not  had  any  training  or  experience  in  air-to-ground  tar¬ 
get  search,  the  following  instructions  should  help  you. 

If  you  are  experienced,  we  suggest  you  review  this  information.  In 
this  simulation  your  targets  will  be  200:1  scale  models  of  U.S.  M-60  tanks. 
(Examples  of  the  scale  models  are  mounted  in  the  Briefing  Room). 

TACTICS  AND  FORMATION 

Russian  tanks  move  and  attack  in  platoon  formations. 

In  the  attack,  platoon  formations  are  usually  tanks  abreast 
(i.e.,  moving  in  a  line  parallel  to  each  other)  and  spaced  50- 
60  meters  apart. 

Cross-country  tactical  movement  in  the  attack  is  the  rule. 

Roads  are  rarely  used  in  attack  situations. 

SEARCH  PROCEDURES 

Slowly  evenly  sweep  your  view  across  the  search  area.  Your  eye 
fixates  for  a  brief  second.  Thus  look  at  the  area  of  search 
the  way  you  read  this  page,  a  "chunk"  at  a  time. 

Targets  are  different  from  the  background  trees  and  bushes. 

Look  for  regular  shapes,  straight  lines. 

Know  the  relative  size  of  the  target  compared  to  the  expected 
background.  (See  example  in  the  Briefing  Room) 

Know  the  particular  shape  of  the  target.  Shape  changes  as  as¬ 
pect  angle  changes.  The  straight  lines  and  distinctive  pattern 
of  tank  gun,  hull,  and  treads  should  be  noted.  Bushes  and  trees 
conversely,  usually  have  less  precise  edges  and  corners. 

Know  where  to  expect  targets.  It  is  almost  impossible  to  see 
tanks  in  heavy  tree  cover.  In  this  attack  situation  you  should 
search  open  areas  and  fields.  Do  not  expect  to  see  tank  targets 
in  the  trees. 

Differences  in  contrast  of  the  target  with  the  background  are 
good  cues.  Dark  targets  on  light  background  or  light  targets 
on  dark  background  may  be  cues. 

Shadow  may  help  emphasize  contrast  and  provide  a  cue  as  to  tar¬ 
get  shape. 

Your  time  is  limited.  The  longer  you  remain  in  a  search  position 
the  more  likely  it  is  you  may  be  shot  at.  In  this  test  you  will 
have  only  about  one  minute  to  locate  the  area  and  find  your  tar¬ 
gets.  Thus  "learn"  the  area  by  careful  review  of  the  briefing 
photos  and  maps.  Spend  your  time  looking  for  targets. 

"Good  Luck"  is  really  careful  preparation. 
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SEEKVAL  EXPERIMENT  IB1 
AIDED  VISUAL 
TERRAIN  TABLE  EXPERIMENT 

HELICOPTER  EXHIBIT  IV 


TV  TAPE  SCRIPT 


Script:  D,B.  Jones 
D.G.  Smith 

February  5,  1975 
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VIDEO 


SEEKVAL  AIDED  VISUAL  TERRAIN  TABLE  EXPERIMENT 
Experiment  IB1 

AUDIO 


1  TITLE: 

2  Floor  level 
overall  pan 


3  Hign  angle  view 
of  table  zoom  out 
from  C.U.  to  L.S. 


4  L.S.  cockpit 
dolly  in  and 
zoom  to  C.U. 
cockpit 


NARRATOR: 

This  is  the  optical  laboratory  of  the  Martin  Marietta 
Guidance  Development  Center. 

The  scale  terrain  model  housed  here  duplicates  topo¬ 
graphical  sections  of  Fort  Lewis,  Washington,  and  typical 
Central  European  rolling  hills. 

Here  (P)  is  a  German  Farm  Village  with  crossroads 
near  a  river.  The  view  widens  to  reveal  a  pine  tree 
forrested  area  typical  of  Fort  Lewis. 

The  road  running  down  the  right  side  of  the  picture  (P) 
runs  north  and  south  on  the  table  through  our  area  of 
operations . 

Remember  that  the  terrain  model  is  merely  a  realistic 
simulation  of  these  georgraphic  areas. 

The  blue  structure  on  the  screen  (P)  is  the  simulated 
cockpit  or  habitat,  from  which  you  will  conduct  your 
search  for  targets. 

On  the  right  (P)  is  the  experimenter's  station  where 
we  will  record  the  results  of  your  target  acquisition 
experiment . 

The  simulated  cockpit  contains  several  important 
features  which  we  will  briefly  describe. 


5  C.U.  cockpit  zoom 

to  ECU  and  pantograph 

Move  pantograph 


6  Zoom  to  Optical  Aid 
(Monocular) 


Mounted  in  front  of  you  is  the  operator's  sighting 
station  or  pantograph.  This  operator's  sight 
will  be  used  in  the  optically  aided  and  TV  aided 
experiments . 

It  will  not  be  used  in  the  direct  vision  experiments. 

Mounted  on  top  of  the  operator's  sight  is  a  stabilized 
telescope  used  in  the  optically  aided  experiments. 


7  Cut  to  Thumb 
Switch 


Either  of  the  read  thumb  switches  on  the  operator's 
sight  can  be  used  to  signal  target  acquisition  and  end 
the  run. 


8  C.U.  cockpit  zoom 
in  to  ECU 
track  stick 


On  the  operator's  left  is  the  track  stick,  (f) 
used  to  control  and  point  the  sensor  in  the  aid  cl 
experiments,  and  to  record  when  you  huve  acquired  me 
target  for  the  direct  vision  experiment. 

The  trigger  switch  (P) ,  actuated  by  the  index  finger, 
indicates  that  you  have  identified  the  targets  and 
ends  the  experimental  run. 
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VIDEO 


9  Pan  RT  to  ECU  TV 
display  and  zoom 
out  to  C.U.  cockpit 


10  C.S  cockpit  and 
experimenter 
station. 

(FADE  OUT) 

(FADE  IN) 

11  Overall  shot 
Terrain  Model 


12  MS  village  on 
terrain  model 
(Color  Run  it  1) 
(Location  1) 


13  Black  and  white 

(Run  #1,  Location  1) 


14  Color  Run  2 

Shoot  to  tank  on 
hill  (Location  2) 


15  B4W,  Location  2 

1  6  Color  Run  it 3 
i.ocation  3 


AUDIO 

Located  directly  in  front  of  you  (P)  is  a  video 
display  unit. 

This  unit  is  used  in  the  TV  aided  experiments 
only  and  will  be  turned  off  for  direct  visual  and 
optical  aided  runs. 

Located  to  the  pilot's  left  (?)  is  the  experimenter's 
station  where  the  experimenter  will  record  the  test  data. 


You  will  be  brought  to  a  simulated  elevation  and 
fixed  in  a  simulated  hover  position. 

The  terrain  table  will  be  positioned  at  a  fixed 
range.  The  curtain  will  be  lifted  in  front  ot  you  and 
remain  open  (for  one  minute)  or  until  you  find  the 
target . 

Our  target  for  this  first  demonstration  run  is  a 
group  of  three  tanks  which  are  heading  southeast,  near 
the  village  you  previously  saw.  You  are  looking  north 
from  a  hovering  elevation  of  400  meters  and  a  range  of 
4.2  kilometers.  The  scene  is  scaled  at  200:1.  We 
will  zoom  in  on  the  target  with  the  TV. 

Now  you  should  be  able  to  see  the  tanks  clearly. 

The  TV  aided  portion  of  the  experiment  will  be 
conducted  using  black/white  TV  imagerv.  Let's 
repeat  the  previous  scene  using  the  hlack/whitc 
TV  system  you  will  be  using.  We  will  zoom  in  on 
the  target  with  the  TV  aid  some  of  you  will  be  using. 

Now  we  will  run  a  series  of  color  and  B'W  runs 
at  various  target  locations.  In  this  case,  a  tank  is 
located  on  the  hillside,  overlooking  a  crossroad. 

The  hovering  elevation  is  600  meters  and  the  range  is 
4.2  kilometers. 

Now  let's  repeat  the  scene  with  the  black  and  white 
camera  and  zoom  in  on  the  target. 

In  this  run  the  target  should  be  a  bit  tasit  r  to 

find.  The  tanks  are  in  the  southeast  so : t .  >  i  to  the  left 

of  the  north/south  road  and  just  below  the  main  east .west 

road . 
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VIDEO 


AUDIO 


.7  Black  &  white 
Run  3 

Location  3 


18  Color  Run  4 
Location  4 


19  Black  &  White 
Location  4 


20  Close  up  of 
tanks 

Location  4 

21  Overall  shot 
over  terrain  to 
simulator  zoom 
in  to  cockpit 
module 


22  TITLE:  Martin 

Marietta 


In  this  B&W  run,  it  is  as  easy,  or  perhaps  easier, 
to  acquire  the  target,  especially  with  the  zoom  lens. 

The  tank  targets  are  at  a  simulated  range  of 
approximately  2800  meters. 

In  these  runs,  the  helicopter  simply  rises  to  altitude 
and  our  camera  zooms  in  on  the  target. 

Here  the  target  is  located  in  a  group  of  bushes 
in  a  direct  line  over  the  east/west  road  on  the  east 
side  of  our  sector.  Two  tanks  have  forded  the  stream. 

In  the  black  and  white  run  we  are  searching  for  the 
targets  with  the  TV  aid.  When  we  find  the  tank,  it's 
quite  obvious. 

From  these  demonstrations  we  have  seen  that  the 
targets  vary  in  color  and  contrast,  making  some 
targets  more  difficult  to  spot  than  others. 

The  previous  illustration  runs  have  been  shown 
so  that  you  will  have  some  idea  of  what  will  be 
required  of  you  during  the  experiments. 

The  video  program  has  also  shown  you  the  environment 
you  will  be  working  in. 

Your  participation  in  this  experiment  is  essential 
to  the  scientific  evaluation  of  some  of  the  key 
factors  in  target  acquisition. 

The  success  of  our  joint  efforts  depends  on  your 
active  and  efficient  performance  in  our  simulation 
of  the  combat  air  support  target  acquisition  process. 

Thank  you  for  your  participation. 
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SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-1D 
ROTARY-WING  MISSION  BRIEFING 


EXHIBIT  V 


Here  on  the  wall  is  a  photograph  of  our  terrain  model.  The  model  is  12 
meters  by  12  meters.  This  photograph  is  an  oblique  view  representing  what  you 
will  see  from  the  cockpit  simulator  as  you  approach  your  target  area.  The 
photograph  is  divided  into  four  different  target  areas.  You  will  search  for 
your  targets  one  area  at  a  time.  Your  targets  will  be  only  tanks.  They  will 
be  exactly  the  size  of  the  tanks  you  see  on  the  model  here.  The  tanks  will 
always  be  on  the  open  terrain,  although  some  clutter  may  be  around  them, 
and  never  in  the  heavily  forested  areas.  You  will  be  flying  over  a  free-fire 
zone.  Any  tank  you  see  in  the  particular  area  you  are  searching  is  a  target. 

You  will  carry  with  you  in  your  cockpit  a  copy  of  this  photograph  with  the 
four  target  areas  outlined,  to  be  used  as  a  mission  briefing.  You  will  first 
search  in  area  one,  then  two,  three  and  four.  The  map  above  is  a  top  view  of 
the  same  terrain  with  the  four  target  areas  outlined.  It  shows  topographical 
features  of  the  terrain.  On  the  sides  are  close-up  view  photographs  of  the  four 
target  areas. 

As  you  saw  in  the  film,  your  cockpit  will  be  brought  to  a  simulated  altitude 
with  the  curtain  down.  The  terrain  is  set  at  a  fixed  range.  The  curtain  is 
lifted  in  front  of  you  and  we  start  timing  you.  You  search  for  the  targets 
until  you  find  them  or  for  a  maximum  of  one  minute.  This  simulates  helicopter 
pop-up  maneuvers. 

When  you  see  your  target  you  signal  acquisition  by  pressing  the  trigger  on 
the  control  stick  or  the  thumb  switches  on  the  sighting  station.  You  signal  ac¬ 
quisition  when  you  are  sure  enough  of  your  target's  location  that  you  are 
willing  to  commit  ordnance.  (Remember  that  the  "enemy"  could  be  shooting  back.) 
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Exhibit  X  .  Target  Area  III 


SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-1D1 

ROTARY -WING  TARGET  AREA  DESCRIPTION  EXHIBIT  XII 

Area  I  is  on  the  SW  corner  of  the  terrain  model.  It  is  bounded  on  the  east 
by  the  N-S  highway  that  runs  through  the  center  of  the  model,  and  on  the 
north  by  the  E-W  highway  that  runs  through  the  heavily  wooded  area. 

Area  II  is  on  the  NW  corner  of  the  terrain  model.  It  is  bounded  on  the 
east  by  the  N-S  highway  that  runs  through  the  center  of  the  model,  and  on 
the  south  by  the  E-W  highway  that  runs  through  the  heavily  wooded  area. 

Area  III  is  on  the  SE  corner  of  the  terrain  model.  It  is  bounded  on  the 
west  by  the  N-S  highway  that  runs  through  the  center  of  the  model,  and 
on  the  north  by  the  E-W  highway  that  divides  the  model. 

Area  IV  is  on  the  NE  corner  of  the  terrain  model.  It  is  bounded  on  the 
west  by  the  N-S  highway  that  runs  through  the  center  of  the  model,  and 
on  the  south  by  the  E-W  highway  that  divides  the  model. 


Immediately  the  curtain  comes  down  in  I  runt  ot  you,  the  run  stops  and  the  time 
it  took  you  to  spot  your  target  is  recorded  by  the  computer. 

While  the  curtain  is  down,  the  cockpit  and  terrain  will  be  repositioned 
for  the  next  run.  During  this  time  your  Experimenter  will  ask  you  questions 
about  the  target  you  just  saw.  You  can  show  him  by  pointing  out  on  your 
photograph,  the  location  of  the  targets,  the  number  of  tanks  that  you  saw, 
the  color  of  the  tanks,  and,  if  you  were  close  enough  to  tell,  the  direction 
in  which  the  tanks  were  headed. 

Although  there  may  be  more  than  one  tank  per  target  area,  you  trigger-off 
only  once  per  run. 

Your  cockpit  will  be  positioned  either  left  or  right,  depending  on  which 
side  of  the  terrain  you  are  searching  for  targets  in. 

Are  there  any  questions  on  what  we  have  talked  about  so  far? 

Now,  using  the  mockup,  I  will  demonstrate  what  you  will  do  in  your  cockpit. 
Each  one  of  you  will  use  one  of  the  three  difffeent  search  methods:  direct  vision, 
in  which  you  look  directly  at  the  terrain  and  when  you  see  the  target  you 
press  the  trigger;  direct  vision  aided  by  a  stabilized  telescope;  and  direct 
vision  aided  by  the  TV  sensor  with  the  zoom  lens  capability. 

(At  this  point  tell  each  observer  what  type  ot  search  method  they  will  use.) 

(Call  out  the  first  name  and  demonstrate  equipment.  Example:) 

Direct  Vision: 

You  will  enter  your  cockpit  and  sit  on  a  seat  identical  to  this  one;  you 
will  fasten  the  safety  straps.  When  the  curtain  comes  up,  you  look  directly 
on  the  terrain.  When  you  see  the  target  you  use  the  trigger  switch  on  the  control 
stick  to  signal  acquisition.  The  TV  screen  in  front  of  you  will  be  off. 

(Call  out  the  next  observer  and  demonstrate  equipment.  Example:) 

Optical  Aid 

You  look  directly  at  the  terrain  when  the  curtain  comes  up.  The  telescope 
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is  an  aid  and  you  do  not  have  to  use  it.  When  you  see  the  target,  you  use 
either  of  the  thumb  switches  to  signal  acquisition  and  stop  the  run. 

If  you  see  something  and  you  are  not  certain  it  is  a  target,  then  you 
may  want  to  use  the  optical  aid.  Bring  it  up  to  your  eye  level.  When  you  see 
your  target,  trigger  off.  Before  you  start  your  run,  you  will  get  a  chance  to 
adjust  the  telescope  to  your  individual  eye  sight  and  to  focus  it.  Once  in 
focus,  it  remains  the  same  for  all  four  runs. 

(Call  out  the  next  observer  and  demonstrate  equipment.  Example:) 

TV  Aid 

Again  you  look  directly  at  the  terrain  when  the  curtain  comes  up.  When 
you  see  the  target,  use  either  of  the  thumb  switches  to  signal  acquisition 
and  stop  the  run. 

If  you  want  to  verify  that  what  you  see  is  the  target,  you  may  want  to  use 
the  TV  aid. 

The  TV  sensor  is  linked  to  the  sight.  You  will  see  a  cross-hair  projected 
on  the  slanted  glass  on  the  sight.  Whatever  you  aim  the  cross-hair  on  will 
be  projected  on  the  TV  screen  in  front  of  you. 

To  look  at  your  TV  screen,  first  aim  the  cross-hair  at  the  possible 

target.  Press  either  index  switch  and  the  TV  sensor  locks-in  on  the  target. 

Now  you  can  let  the  sighting  station  down  so  you  can  see  the  TV  screen.  You  can 

control  the  TV  sensor  by  moving  the  stick  on  your  left.  The  center  knob 

controls  the  field  of  view  of  the  TV  aid.  Use  the  trigger  switch  on  the  control 
stick  to  signal  acquisition  while  looking  at  your  TV. 

If  you  did  not  see  the  target  and  want  to  return  to  searching  through 
direct  vision,  bring  up  the  sighting  station  to  look  through  the  cross-hair 
and  press  either  lower  switch.  The  TV  sensor  will  again  be  slaved  to  the 
sight.  You  can  switch  back  and  forth  any  number  of  times.  However,  time  is 
important,  so  if  you  see  the  target  in  any  mode,  try  to  signal  acquisition 
without  switching  to  a  different  mode  of  search,  since  this  will  cost  you  time. 
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For  those  of  you  who  will  be  using  tin-  aids,  you  wiil  got  a  chance  to 
play"  with  them  before  you  start  your  runs  so  that  you  will  be  tally  familiar 
with  their  operation.  Remember  that  the  aids  are  just  that,  aids.  You  do 
not  have  to  use  them  if  you  find  you  can  do  bet  Lor  without  them.  1!  thetc 
are  no  more  questions  we  will  go  to  the  Holding  Room  which  is  right  outside 
the  lab.  There  you  will  wait  for  your  Experimenter.  You  will  not  return  to 
this  room,  so  take  ail  personal  belongings  with  you. 

(Observers  are  transferred  to  Holding  Room.) 
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SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-4B 

ROTARY  WING  RUN  BRIEFING  EXHIBIT  XIII 

You  have  reviewed  the  briefing  materials  and  should  be  familiar  with  the 
map  and  aerial  photos  of  the  target  area. 

Remember  that  the  target  area  is  a  free-fire  zone.  Any  tanks  you  may 
find  in  the  areas  can  be  fired  upon.  In  this  experiment  we  will  ask  you  to 
find  tanks  as  targets.  When  any  particular  target  has  been  found  to  your 
satisfaction  place  the  sight  reticle  (for  SO  missions,  the  telescope,  for 
EO  missions,  the  pantograph  sight)  on  the  target  and  keep  it  there  when 
you  press  the  event  marker  switch.  Do  not  press  the  switch  until  you  have 
found  the  target  and  are  ready  to  end  the  run.  On  the  track  stick  in  your 
left  hand  is  the  event  marker  switch  (for  SO  and  EO  missions,  the  two  push¬ 
buttons  on  the  pantograph  handles  are  also  available)  for  Direct  View 
Missions.  When  you  depress  these  switches  (or  any  of  them)  you  are  indica¬ 
ting  that  you  have  found  the  target.  This  means  that  you  have  found  a  tar¬ 
get  and  are  sure  enough  of  its  location  that  you  are  willing  to  attack. 

When  you  depress  these  switches  (or  any  one  of  them)  the  run  ends. 

When  the  run  begins  this  curtain  will  rise  out  of  the  way  and  you  can 
see  the  area  of  operations.  First  find  the  area  in  which  your  target  should 
be  located,  then  begin  your  search  for  tanks.  When  you  find  any  tanks  be 
sure  to  keep  the  sight  reticle  or  instrument  on  them. 

When  you  have  found  the  target  depress  the  indicator  switch. 

That  terminates  the  run.  The  curtain  will  drop  in  front  of  you.  I 
will  then  ask  you  some  questions  about  the  target  to  help  verify  some  of 
the  data  we  are  collecting. 


If  by  chance  you  have  not  found  the  target  in  time  the  curtain  will 
close  and  that  also  ends  the  run. 

Meanwhile  you  are  repositioned  and  the  setup  for  the  next  run  is  pre¬ 
pared  and  verified. 

I  will  brief  you  on  the  next  target  and  we  repeat  the  sequence. 

Here  is  the  aerial  photograph  of  our  general  operational  area.  Keep  it 
for  all  flights.  On  this  mission  enemy  tanks  have  been  reported  in  this 
area  of  your  zone  of  operations.  The  target  area  is  described  as:  [The 
Observer  is  handed  the  photograph  (Exhibit  VII),  and  for  each  run  the  appro¬ 
priate  area  description  from  Exhibit  XII  is  provided  verbally.] 

Do  you  have  any  questions  about  how  we  will  operate? 

Do  you  understand  how  your  equipment  operates?  In  this  test  you  will 
search  for  targets  using  direct  vision.  (*If  this  is  an  aided  mission,  the 
comments  below  are  inserted  at  this  point).  Do  not  press  the  switch  until 
you  have  found  the  target  and  are  ready  to  end  the  run. 

Are  you  ready?  (To  test  conductor)  Experimenter  ready  I 

*(In  the  case  of  SO); 

In  addition,  you  have  the  option  of  using  the  binocular  unit  mounted 
on  the  pantograph  sight.  You  will  not  be  using  the  pantograph  sight  itself. 
We  will  be  operating  at  (  )  range  and  have  to  focus  the  binocular  for  that 

range.  That  target  (or  bolt  or  column)  over  there  is  at  the  correct  range. 
(The  Observer  is  assisted  in  focusing).  That  panel  on  the  easel  in  front 
of  you,  there,  was  placed  to  prevent  inadvertent  observation  of  the  target 
area  on  the  terrain  model;  so  feel  free  to  check  out  the  binocular. 
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(In  the  case  of  EO)  : 

In  addition,  you  have  the  option  of  using  the  TV  system  as  an  aid.  The 
recommended  way  of  using  this  system  is  as  follows:  (1)  Look  through  the 
sight  system  on  the  pantograph  and  identify  a  suspicious  target  area;  with 
the  pantograph  pointed  at  the  area,  press  either  upper  trigger  on  the  pan¬ 
tograph  handles;  the  TV  is  now  locked  on  the  area  and  control  has  been 
transferred  to  the  track-stick.  Swing  the  pantograph  out  of  way  and,  look¬ 
ing  at  the  TV  display,  home-in  on  the  presumed  target  with  the  track-stick. 
If  it  turns  out  that  there  is  not  a  target  there,  the  whole  procedure  can 
be  reinstituted  by  pressing  either  lower  trigger  on  either  pantograph 
handle,  returning  control  to  the  pantograph.  I  suggest  you  practice  shift¬ 
ing  back  and  forth  from  one  control  or  another  using  the  marks  on  the  panel 
on  the  easel  in  front  of  you.  (This  practice  was  continued  for  about  a 
minute  and  then  the  regular  procedure  was  resumed) . 
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SEEKVAL  EXPERIMENT  IB1 
PROCEDURE  SVIB1-8 

MISSION  DEBRIEFING  EXHIBIT  XIV 

Thank  you  for  participating  in  this  series  of  SEEKVAL  experiments. 

As  I  told  you  when  we  first  began  our  runs,  there  are  no  right  answers. 
The  tests  have  been  designed  not  as  a  performance  measure  but  as  an  experi¬ 
ment.  In  general,  your  mission  has  been  to  find  tank  targets  in  terrain 
typical  of  central  Europe.  We  have,  as  you  have  seen,  varied  locations  and 
other  factors  related  to  the  target.  Our  objective  has  been  to  secure  base¬ 
line  data  that  will  be  useful  in  future  operations.  As  near  as  I  can  tell, 
your  personal  performance  was  very  good.  The  results  will  help  us  very 
much. 

You  will,  I'm  certain,  have  a  chance  to  discuss  what  you  saw  and  did 
here  today  with  other  members  of  your  unit  (or  other  employees  at  Martin 
Marietta).  We  ask  you,  in  the  name  of  good  scientific  research,  not  to 
talk  about  what  you  saw  and  did  in  any  detail.  The  name  of  this  game  is 
research.  In  the  good  name  of  science  we  ask  you  to  not  discuss  your  re¬ 
sults  with  others.  It  is  vital  to  the  experiment  that  all  participants 
start  out  with  essentially  the  same  knowledge  about  the  terrain  and  the 
operations  that  are  being  conducted.  If  you  talk  too  much  about  the  situ¬ 
ation,  especially  to  those  who  have  not  had  their  turn  you  could  well 
invalidate  the  results.  Particularly,  the  layout  of  the  terrain  and  the 
targets  locations  are  sensitive  and  should  not  be  talked  about. 

You  should  also  know  that  not  everyone  is  doing  the  same  thing.  Each 
group  of  participants  here  will  perform  a  different  set  of  missions.  While 
the  terrain  in  which  you  searched  for  our  tank  targets  is  the  same  for 
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everyone  the  procedure  used  and  the  targets  are  not  always  the  same.  Thus 
even  If  you  "compare  notes"  with  some  other  participants  you  may  find  out 
he  did  not  do  what  you  did.  When  you  do  this,  some  future  participant  may 
hear  you. 

Thank  you  again.  Your  part  is  done.  You  may  now  return  to  your  duties 
Please  do  not  go  back  to  the  reception  and  briefing  area.  (Military  per¬ 
sonnel  may  wait  in  the  Debriefing  Room,  but  not  in  the  Ready  Room.  If  you 
desire,  I  will  escort  you  there.) 


Number : 

Name : 

SEEKVAL  HELICOPTER  DEBRIEFINC  QUESTIONNAIRE  EXHIBIT  XV 

Please  help  us  with  this  study  by  answering  the  following  questions  honestly 
and  candidly. 

!•  Was  the  visual  scene  (terrain  model,  target  area  and  targets)  a  realis¬ 
tic  simulation?  Yes  No 

Comment  s 


2.  Did  the  target  area  briefings  help  you?  Yes  No 

Comments 


3.  Was  the  general  information  briefing  and  taped  TV  presentation  helpful 
in  showing  you  what  to  expect?  Yes  No 

Comments 


In  some  test  runs  a  stabilized  optic  (monocular 

telescope) 

was  available 

Did  you  have  a  stabilized  optical  aid? 

If  yes,  please  answer  the  following: 

Yes 

No 

Did  you  use  the  telescope  at  all? 

Yes 

No 

Did  the  telescope  help  you  find  targets? 

Yes 

No 

Did  the  sighting  station  mount  help  you  use  the 
Comments 

telescope? 

Yes 

No 

5.  In  some  test  runs  a  television  was  available.  Did  you  have  a  TV? 
Yes  No 


If  yes,  please  answer  the  following: 


a. 

Did 

you 

use  the  TV  at  all? 

Yes 

No 

b. 

Did 

the 

TV  help  you  find  targets? 

Yes 

No 

c. 

Did 

the 

Operators  sight  help  you  use  the 

TV? 

Yes 

No 

d. 

Was 

the 

track  stick  helpful  in  using  the 

TV? 

Yes 

No 

Comments 


6.  What  suggestions  can  you  make  to  help  improve  this  test? 
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APPENDIX  K 


Experimental  Data 

The  experimental  data  was  listed  on  cards  in  the  format  shown  below  and  a 
sample  data  card  is  included.  The  following  pages  list  the  experimental  data  by  sub¬ 
experiment  . 

SEEKVAL  CATA  CARD  DESC«IPTI6N 
GENERAL  FORMAT 
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6136.3  U  0116  FW  E  WF  ML 

1148.3  T  0115  FW  E  VF  HU 

2148.3  T  0115  FW  E  VF  LH 

3148.3  T  0115  FW  E  VF  MH 

4148.3  T  0115  FW  E  VF  HH 

5148.3  T  0115  FW  E  VF  LL 

6148.3  T  0115  FW  E  VF  ML 

1149.3  U  0115  FW  E  VF  HL 

2149.3  U  0115  FW  E  VF  LH 

3149.3  U  0115  FW  E  VF  MH 

4149.3  U  0115  FW  E  VF  HH 

5149.3  U  0115  FW  E  VF  LL 

6149.3  b  0115  FW  E  VF  ml 

1142.5  T  0114  FW  E  0V  HL 

2142.5  T  0114  FW  E  DV  LH 

3142.5  T  0114  FW  E  DV  "H 

41*2.5  T  0114  FW  E  DV  HH 

5142.5  T  0114  FW  E  DV  LL 

6142.5  T  0114  FW  E  DV  mL 

1012.3  b  0116  Fw  E  DV  «l 

2012.3  b  0116  FW  E  DV  LH 

3012.3  U  0116  FW  E  DV  MH 

4012.3  U  0116  Fw  E  DV  hh 

5012.3  b  0116  FW  E  DV  LL 

6012.3  b  0116  Fw  E  DV  ~L 

1143.7  T  0114  Fw  E  NF  HL 

2143.7  T  0114  FW  E  NF  LH 

3143.7  T  0114  FW  E  NF  hH 

4143.7  T  0114  FW  E  NF  hh 

5143.7  T  0114  Fw  E  NF  LL 

6143.7  T  0114  FW  E  NF  “L 

1158.3  b  0116  FW  E  NF  hL 

2158.3  U  0116  FW  E  NF  LH 

3158.3  b  0116  FW  E  NF  "H 

4158.3  b  0116  FW  E  NF  hh 

5158.3  b  0116  FW  E  NF  LL 

6158.3  b  0116  FW  E  NF  «L 

1144.4  T  Cl 14  FW  E  WF  HL 

2144.4  T  0114  FW  E  WF  LH 

3144.4  T  0114  FW  E  WF  MH 

4144.4  T  0114  FW  E  wF  HH 

5144.4  T  0114  FW  F  WF  LL 

6144.4  T  0114  F*  E  WF  "L 

1159.3  b  0116  Fw  E  wF  hl 

2159.3  b  0116  FW  E  wF  LH 

3159.3  b  0116  FW  E  WF  «H 

4159.3  b  0116  FW  E  wF  HH 

5159.3  b  0116  FW  E  WF  LL 

6159.3  b  0116  FW  E  WF  ml 

1145.3  T  0114  FW  E  VF  HL 

2145.3  T  0114  FW  E  VF  LH 

3145.3  T  0114  FW  E  VF  mh 

4145.3  T  0114  FW  E  VF  HH 


40  135  3000  BD  GR  3  05845  3  0 

32  135  3000  8D  GR  3  02150  0  1 

40  135  3000  BD  GR  3  06750  3  0 

40  135  3000  BD  QR  3  02044  0  0 

32  135  3000  BD  QR  3  08775  0  3 

*0  135  3000  BD  GR  3  05678  3  0 

40  135  3000  BD  GR  3  04032  3  0 

32  135  3000  BD  GR  3  01837  0  2 

40  135  3000  80  GR  3  05373  3  0 

40  135  3000  BO  GR  3  03822  0  ? 

32  135  3000  BD  GR  3  03390  0  1 

40  135  3000  BD  GR  3  05466  3  " 

40  135  3000  BD  G»  3  03377  3  0 

90  --  3000  BD  GR  3  0135"  o  " 

90  --  3000  BD  GR  3  01820  0  0 

90  ••  3000  BD  GR  3  10160  0  3 

90  --  3000  BD  GR  3  01313  0  0 

90  --  3000-80  GR  3  0331?  3  0 

90  --  3000  BO  GR  3  08484  0  4 

90  »-  3000  80  GR  3  0362?  2  0 

90  --  3000  BD  GR  3  06524  3  0 

90  --  3000  BD  GR  3  05047  2  0 

90  •*  3000  BD  GR  3  03553  2  0 

90  --  3000  BD  GR  3  04084  1  0 

90  --  3000  BD  GR  3  03560  3  0 

90  --  3000  BD  GR  3  0316?  3  0 

90  --  3000  BD  GR  3  "882°  0  3 

90  --  3000  80  GR  3  0?325  0  ? 

90  --  3000  BD  GR  3  02760  0  1 

90  *•  3000  BO  GR  3  01630  0  0 

90  --  3000  BD  GR  3  03725  3  0 

90  --  3000  BO  QR  3  01727  0  0 

90  --  3000  BD  GR  3  02350  3  C 

90  --  3000  BO  GR  3  03005  3  0 

90  •-  3000  BD  GR  3  01701  0  0 

90  --  3000  BD  GR  3  02732  3  0 

90  --  3000  BD  GR  3  02961  3  0 

90  «-  3000  BD  GR  3  10641  0  2 

90  --  3000  BD  GR  3  "700"  3  o 

90  --  3000  BD  GR  3  0RS3?  3  1 

90  --  3000  BD  GR  3  "«795  3  0 

90  --  3000  BD  GR  3  071 7*  0  1 

90  --  3000  BO  GR  3  0R»20  0  1 

90  --  3000  BD  GR  3  0? 926  0  2 

90  -•  3000  BD  GR  3  "399?  3  0 

90  *-  3000  BD  GR  3  0460'=:  0  ? 

90  --  3000  BD  GR  3  03963  3  0 

90  --  3000  BD  GR  3  0?527  3  0 

90  --  3000  BD  GR  3  0299?  3  0 

90  --  3000  BD  QR  3  05960  0  1 

90  --  3000  HO  3R  3  06380  0  4 

90  --  3000  BD  GR  3  0525*  P  ? 

90  --  3000  BD  GR  3  073?0  0  3 
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050.1  SEARS  1 
o?7 • 0  SEARS  1 
035.8  SEARS  1 
O30»4  SEARS  1 
033.5  SEARS  1 
014.0  SEARS  1 
027.3  SEARS  1 
032.1  SEARS  1 
019.0  SEARS  1 
017.7  SEARS  1 
064.8  RPM  ANS  4 
059.9  RPM  AN'S  7 
058*4  R8RA\'S  7 
013.0  ROMANS  4 
033*7  RPMANS  4 
"47.5  RPMANS  4 
055. 5  SEARS  4 

047.7  SEARS  4 
046.3  SEARS  4 
050.0  SEARS  1 
"47.9  SEARS  4 
04«*6  SEARS  4 
"31.1  PP^ANS  5 
053.5  RPMANS  4 
034.1  ROMANS  1 
"33."  RPMAN'S  3 
048.4  RP“ANS  1 
"51*2  ROMANS  5 
"19.5  SEARS  2 
"07.5  SEARS  3 
"40*5  SEARS  4 
050.8  SEARS  4 
"38.8  SEARS  4 
"34.6  SEARS  4 
065*1  RPMANS  4 
046. 0  ROMANS  4 
op6.0  P R A \ S  4 

"19, P  ROMANS  <* 
"4°  .  ?  ROMANS  4 
"40‘A  ROMANS  1 
"66.3  PPVA\S  2 
"5? • 8  RP^avs  p 
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BR  3  04300  0  3  021.4  SEARS  1  5042.1 
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BR  3  04200  3  0  002. 5  ROMANS  1  "043.9 
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BR  3  01509  3  9  003.2  R0m an‘S  1  co"9.4 
GR  3  01500  3  9  '"9,6  SEARS  °  "053.1 
BR  3  915G0  3  9  op". 5  SEARS  1  "953,9 
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4575*4  U  0304  RH  M  SB  M  90  --  '■'800  (BO 

1586*4  T  0305  RW  M  SB  *  90  --  0800  P T 

2586.4  T  0305  RW  P  SB  H  90  --  0800  PT 

3586.4  T  0305  RW  M  SB  L  90  --  OgOO  60 

4586.4  T  0305  RK  B  SB  90  --  0800  60 

1576.3  U  0304  RW  M  SB  (*  90  --  ogOO  PT 

2576.3  U  0304  Rw  B  SB  M  90  --  ogQO  PT 

3576.3  U  0304  Rw  N  SS  L  90  --  OgOO  *0 

4576.3  U  0304  RW  M  SS  »  90  --  0800  *0 

1587.4  T  0305  Rw  K  EB  M  90  --  0800  PT 

2587.4  T  0305  RW  M  EB  H  90  --  0800  PT 

3587.4  T  0305  RW  M  EB  L  90  --  0800  80 

4587.4  T  0305  RW  M  EB  M  90  --  0800  80 

1588.3  U  0305  RW  B  EB  "  90  --  0800  PT 

2588.3  U  0305  RW  M  EB  h  90  --  0800  PT 

3588.3  U  0305  RW  M  EB  L  90  --  0800  60 

4588.3  U  0305  RW  M  EB  6  90  -*  0800  SO 

1590.4  T  0305  RW  K  E8  M  90  --  ogOO  PT 

2590.4  T  0305  RW  M  EB  w  90  --  6800  PT 

3590.4  T  0305  RW  B  [6  L  90  --  6800  80 

4590.4  T  0305  RW  B  ES  ^  90  --  0800  80 

1589.4  U  0305  RW  M  E6  M  90  --  0800  PT 

2589.4  U  0305  RW  6  EB  H  90  --  0800  PT 

3589.4  U  0305  Rw  M  EB  L  90  --  0800  BO 

4589.4  U  0305  RW  B  EB  y  90  --  0800  60 

1591.3  T  0305  RW  N  DV  9  90  --  0800  BO 

2591.3  T  0305  RW  N  DV  H  90  --  n800  8D 

3591.3  T  0305  RW  N  DV  L  90  --  ogOO  PT 

4591.3  T  0305  RW  N  DV  M  90  --  ogOO  PT 

1598.3  U  0305  Rw  N  DV  M  90  --  0800  BO 

2598.3  U  0305  Rw  N  OV  w  90  --  0800  BO 

3598.3  U  0305  RW  N  DV  L  90  --  0«C0  PT 

4598.3  U  0305  RW  K  DV  *  90  --  0800  PT 

1592.4  T  0305  Rw  \  OV  ”  go  --  6*00  80 

2592.4  T  0305  RW  N  DV  n  90  --  0800  BD 

3592.4  T  0305  Rw  \  DV  L  90  --  0800  PT 

4592.4  T  0305  RW  \  DV  M  90  --  0800  PT 

1599.3  U  0305  Rw  N  DV  M  90  --  0800  BO 

2599.3  U  0305  Rw  N  DV  w  q0  --  ogOO  BD 

3599.3  U  0305  Rw  N  DV  L  90  --  0800  PT 

4599.3  U  0305  Rw  \  DV  M  90  --  0800  PT 

1593.4  T  0305  Rw  \  SB  w  90  *-  ogOO  BD 

2593.4  T  0305  RW  \  SB  h  90  --  0800  BD 

3593.4  T  0305  RW  N  SB  L  90  --  ogOO  PT 

4593.4  T  0305  RW  U  SB  *  90  --  0800  PT 

1601.4  U  0306  RW  N  SB  M  90  --  0800  BD 

260 1 « 4  U  0306  Rw  N  SB  H  90  --  0800  80 

3601*4  b  0306  RW  N  SB  L  90  --  0800  PT 

46C1*4  U  0306  RW  N  SB  M  90  --  ogOO  PT 

1594.4  T  0305  Rw  N  SB  M  90  0800  BO 

2594.4  T  C305  RW  !>'  SB  *-  90  --  0800  BO 

3594.4  T  0305  Rw  N  SB  L  90  --  0800  °T 

4594.4  T  0305  RW  N  SB  M  90  --  0800  PT 


gw  3  p4?on  p  6  005.7  SEARS  8  =066.4 

GW  3  04?no  3  O  0?1.6  SE'RS  9  =067.1 

HR  3  04?po  3  o  ojsp,7  SEARS  9  =067.9 

GW  3  O42C0  3  0  031.8  SEARS  9  =067.3 

HP  3  04200  3  0  034.9  SEARS  9  =067.4 

GW  3  04200  2  1  ,'20.7  RBpaNS  q  =068.1 

sr  3  04300  0  0  O60. 0  WBbams  J  =Of.8.2 

GW  3  04200  3  0  014,7  WB-ANS  9  =66=.3 

bW  3  04200  3  o  o;3»3  RBPAKS  9  =06».4 

GW  3  04200  0  0  060*0  ROMANS  G  =n69.1 

QW  3  04200  0  1  031  *3  RP^ANiS  7  =069,3 

GR  3  04200  3  0  005*0  R9PANS  1  =069.3 

8R  3  04200  3  0  opq.g  R6“A\S  7  =069.4 

GR  3  04200  0  0  060.0  SEARS  <*  =070.1 

3W  3  04200  0  0  060* 0  SEARS  7  =070.9 

GR  3  04200  3  0  OR3.I  SEARS  7  =070.3 

BR  3  04200  3  0  O60.o  SEARS  7  =070.4 

GR  3  04200  2  0  053.7  PBBAVS  7  =071.1 

B»  3  04200  3  o  ogg  ,  g  ROMANS  7  =071.2 

GR  3  04200  3  0  opg.s  R  9  “  A  \  S  1  =071,9 

BR  3  04200  3  0  013.3  R«“a\S  1  =071.4 

GR  3  04300  3  0  oog.»  RpmanS  1  =073,1 

gw  3  04200  3  o  055.3  WOMANS  7  =073.? 

GR  3  04200  3  o  o^s  »  8  r-  B  ^  a  \S  1  =079.3 

gw  3  0430P  3  0  049.I  PRmAnS  7  =072.4 

GR  3  01500  3  0  009.9  RgPASS  1  =079.1 

BR  3  01500  3  0  opq,?  RBBANS  1  =073.2 

GR  3  01500  3  O  002*0  pb^aniS  1  =073. 3 

8R  3  01500  3  o  002*3  RflPANS  1  5073.4 

GR  3  01500  3  o  P0?»6  SEARS  1  =074.1 

BR  3  01 =00  3  0  003.8  SEARS  1  =074.2 

GR  3  01500  3  n  001,9  SEARS  1  5n74.3 

BR  3  01500  3  o  op-5. 3  SEARS  1  =074.4 

GR  3  01500  3  0  00?. 3  =  EA?S  1  =n75.1 

gw  3  015Cn  3  p  002.2  sears  1  =075.9 

GR  3  01500  3  0  001. 2  Sears  1  =075.3 

BR  3  01500  3  0  001.6  SEARS  1  =^75. 4 

GR  3  01500  3  o  004.4  RB^AVS  1  =076.1 

=R  3  O15O0  3  0  9P4,6  WB'"ANS  1  =n76.2 

GR  3  01500  3  0  ops, 7  RB"AVS  1  =076.3 

B«  3  01500  3  0  ops, 7  f-Bf/A\S  1  =076.4 

qw  3  01500  3  0  001*0  RB^ASS  1  =077.1 

gw  3  RISO"1  ?  o  ppq.f  RQMA\S  1  =077,? 

GP  3  01=00  3  o  pci .1  Rfi-A\S  1  =077,3 

BR  3  01=00  9  O  pop.s  RB-ASS  J  =077.4 

GR  3  015  C/C  3  o  p  1  a  #  9  SEARS  1  =07s • 1 

pP  3  01500  3  p  P07.',  SEARS  1  =078.2 

GW  3  R150O  3  0  oqp.p  REAPS  1  =078,3 

gw  3  015rO  3  O  ^Pg.4  SEARS  1  =078.4 

GR  3  oi5P0  3  0  004,3  SEARS  1  =079.1 

=w  3  01500  3  o  opg. q  sears  1  =079.? 

GW  3  01500  3  0  opi«3  SEARS  1  =079.3 

PR  3  pigpp  3  0  O0p,o  SEARS  1  =079.4 
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